As advised by Christof Marti at microsoft/vscode-remote-release#8436 (comment) VSCode has support for cloning a repo of dotfiles.
And, related docs > https://code.visualstudio.com/docs/devcontainers/containers#_personalizing-with-dotfile-repositories