Hello,
I am a DB admin for SQL, I also deploy Python scripts in virtual machines with MS PowerApps as interface. My goal is to stay as a backend developer.
Currently we have several limitations with parallel processing in the VMs (mostly because of the need of Excel data input from analysts, no RPA needed as it is only reading from Python). I am trying to find which technologies would solve this issue, so far seems like containers would be the step up? I’m guessing this would improve the isolation of the processes, but does this cover all bases including Excel and possibly web scraping?. Also, is it correct that a technology like PySpark should be employed in the VMs to accelerate big data or is this overkill in terms of cost/benefits?
These are the 2 technologies on my list of priorities, but is there something about the use of APIs, microprocesses or other technologies that I am missing out? I want to have my company pay for training but it’s a bit hard to find out online about the actual use of different technologies.
Thanks a lot!
submitted by /u/vadbv
[link] [comments]
r/learnpython Hello, I am a DB admin for SQL, I also deploy Python scripts in virtual machines with MS PowerApps as interface. My goal is to stay as a backend developer. Currently we have several limitations with parallel processing in the VMs (mostly because of the need of Excel data input from analysts, no RPA needed as it is only reading from Python). I am trying to find which technologies would solve this issue, so far seems like containers would be the step up? I’m guessing this would improve the isolation of the processes, but does this cover all bases including Excel and possibly web scraping?. Also, is it correct that a technology like PySpark should be employed in the VMs to accelerate big data or is this overkill in terms of cost/benefits? These are the 2 technologies on my list of priorities, but is there something about the use of APIs, microprocesses or other technologies that I am missing out? I want to have my company pay for training but it’s a bit hard to find out online about the actual use of different technologies. Thanks a lot! submitted by /u/vadbv [link] [comments]
Hello,
I am a DB admin for SQL, I also deploy Python scripts in virtual machines with MS PowerApps as interface. My goal is to stay as a backend developer.
Currently we have several limitations with parallel processing in the VMs (mostly because of the need of Excel data input from analysts, no RPA needed as it is only reading from Python). I am trying to find which technologies would solve this issue, so far seems like containers would be the step up? I’m guessing this would improve the isolation of the processes, but does this cover all bases including Excel and possibly web scraping?. Also, is it correct that a technology like PySpark should be employed in the VMs to accelerate big data or is this overkill in terms of cost/benefits?
These are the 2 technologies on my list of priorities, but is there something about the use of APIs, microprocesses or other technologies that I am missing out? I want to have my company pay for training but it’s a bit hard to find out online about the actual use of different technologies.
Thanks a lot!
submitted by /u/vadbv
[link] [comments]