How to add only the imported libraries to the requirements.txt files
We have provided many tutorials on how to generate the requirements.txt for your python project without environments, how to work with Conda environments, how to work with VS Code and Virtual Environments and so on. Today, we will provide an alternative way to get the requirement.txt file by including only…
My story about investing in Mintos, a P2P Lending Platform.
A Diversified Portfolio
When it comes to investment, I follow the old-time classic idiom “Don’t put all your eggs in one basket”. Generally, I’m a risk-averse person and my “portfolio” consists of cash in bank accounts, flats, and stocks. …
Examples of how to schedule simple and tree tasks in Snowflake
We have started a series of Snowflake tutorials, like How to Get Data from Snowflake using Python, How to Load Data from S3 to Snowflake and What you can do with Snowflake. In this tutorial, we will show you how to schedule tasks in Snowflake. …
An efficient way to handle different connections in a single file!
Data Scientists and Data Engineers may need to access many systems at once. For example, in ETL/ELT jobs there is a chance to extract and store data in different sources like Hadoop, BigQuery, MySQL, PostgreSQL, Redshift, Snowflake, and so on. In addition, there can be different users having different credentials…
DevOps
How to work efficiently with Docker Jupyter Notebooks from your local PC
Data Scientists love to work with Jupyter notebooks. It is possible that in the machine that you have to work on, the Jupyter Notebook with the Anaconda distribution is not available and you do not want to install something so heavy for a one-off task. …
A walk-through example of how to work with Python Virtual Environments in VS Code
We have provided examples of how to work with conda environments. In this post, we will provide you a walk-through example of how to work with VS Code and virtual environments.
Why working with Virtual Environments
When we work on a Data Science project, which can include a Flask API, it is better to have…
The key features of Snowflake
Snowflake is a popular cloud-based data storage and analytics service. Personally, when I examine new technologies and products, I would like to have a summary of the most important features. This allows us to get a general idea of the product and to understand if it covers our needs. …
An example to connect Snowflake with Python
In a previous post, we provided an example of how to load data from S3 to Snowflake. Data Scientists and Data Engineers are very familiar with Python and Pandas Data Frames, so it is essential to be able to connect Snowflake with Python. …
An example of how to load data from S3 to Snowflake
Create a Database
The first thing that we need to do is to create a database. This is easy. We login into the Snowflake platform and we go to Databases.
George Pipis
Data Scientist @ Persado | Co-founder of the Data Science blog: https://predictivehacks.com/
