The need for virtual environments There comes a time in your software development journey when you are working on multiple Python projects, be it for work or some personal project. As we start working on Python projects and as the projects grow, the project dependencies start increasing which we generally install via pip or conda…

What is DevOps? DevOps is a culture in recent software engineering, which aims to streamline the software development process and the operations that go along with while releasing that software to the end-users. DevOps aims to provide a developer experience such that the developers will only have to focus on writing the code…

If you are working on an application that deals with APIs, knowing how to handle HTTP Requests and JSON content is crucial. These two Python libraries come in handy in such scenarios. Requests requests library gives you a simple interface to make HTTP calls to APIs. …

I’m pretty sure you can do this in fewer lines with a heavy library like pandas. If you just don’t want to do that, here’s how you can do that alternatively. Assuming the JSON file looks something like this, and we want to have the keys as the column headers…

If you do a lot of scripting with python, many a times you might need to convert CSVs to JSON files for multitude of reasons. I’ll show you a step-by-step approach on how you can do that in just 10 lines of Python code. Let’s say you have a CSV…

Apache Airflow is an open-source workflow orchestration and scheduling platform. Airflow is extensible, pluggable and highly scalable. It is developed purely on python and therefore can be as versatile as the language itself. Bear in mind though, it is not designed to run any kind of compute-heavy workload, rather it’s…

With Cloud, comes great computing power. And with Great computing power, comes great security responsibility. This article tells you how you can be a responsible cloud practitioner. IAM (Identity and Access Management) Always use the least privileged policy Only provide the specific accesses that the users and applications need. Nothing more, Nothing less. Avoid using…

Imagine working on your projects, without being tied to a single computer or a single place, without installing anything, directly from your browser. How awesome would that be? The following tools provide you with the same experience. Check these out now. GitPod

I assume you already know this since you are here, Apache Airflow is a workflow orchestration and scheduling platform, majorly for your data pipelines, but is not limited to just that. Since Airflow is pure python, it’s as versatile as python can get. …