LEARN PANDAS: Master Data Manipulation, Integration, and Automation in Real-World Projects
About this ebook
This book is intended for students and professionals seeking to master data manipulation, integration, and automation with Pandas and Python in productive environments, covering everything from environment setup to the delivery of reliable and scalable pipelines. It covers efficient reading and writing (CSV, Parquet, Excel, SQL, APIs), advanced data transformation, validation, profiling, performance optimization, versioning, automation, and integration with essential frameworks for data engineering, cloud, and machine learning, always focusing on governance and compliance.
Includes:
• Python, pandas, pyarrow, venv environment setup
• Data ingestion and export: CSV, Parquet, Excel, SQLAlchemy, APIs, cloud integration
• Advanced transformations: merge, groupby, pivot, rolling, reshape, optimized categoricals
• Optimization: vectorization, chunking, Dask, Modin, numexpr, memory profiling
• Validation and auditing: Pandera, Great Expectations, automated testing, DVC
• Pipeline integration: Airflow, Prefect, automation, monitoring, versioning
• Best practices for governance, compliance, and scalable operations
Expand your expertise by delivering professional and robust solutions for data automation, integration, and orchestration, enhancing the efficiency, security, and value of projects in corporate, cloud, and machine learning environments.
pandas, python, data engineering, data pipeline, pyarrow, parquet, dask, modin, sqlalchemy, airflow, prefect, great-expectations, dvc, etl, automation, cloud, data analysis, compliance, performance
About the author
Diego Rodrigues
Technical Author and Independent Researcher
ORCID: https://orcid.org/0009-0006-
StudioD21 Smart Tech Content & Intell Systems
Email: [email protected]
LinkedIn: linkedin.com/in/diegoexpertai
International technical author (tech writer) focused on the structured production of applied knowledge. He is the founder of StudioD21 Smart Tech Content & Intell Systems, where he leads the creation of intelligent frameworks and the publication of didactic technical books supported by artificial intelligence, such as the Kali Linux Extreme series, SMARTBOOKS D21, among others.
Holder of 42 international certifications issued by institutions such as IBM, Google, Microsoft, AWS, Cisco, META, Ec-Council, Palo Alto, and Boston University, he works in the fields of Artificial Intelligence, Machine Learning, Data Science, Big Data, Blockchain, Connectivity Technologies, Ethical Hacking, and Threat Intelligence.
Since 2003, he has developed more than 200 technical projects for brands in Brazil, the USA, and Mexico. In 2024, he established himself as one of the leading technical book authors of the new generation, with over 180 titles published in six languages. His work is based on his proprietary TECHWRITE 2.3 applied technical writing protocol, focused on scalability, conceptual precision, and practical applicability in professional environments.
