Walnut DataTech
Create account

Python for data engineering

Build data pipelines that are readable, testable and safe to run again, with Python and pandas.

No reviews yetTaught by Priya Raman
Level
Intermediate
Language
English
Duration
24 hours
Lessons
10

Last updated 8 Oct 2026

What you'll learn.

  • Structure a pipeline project with configuration kept out of the code
  • Read and write files safely and handle time zones correctly
  • Clean, join and aggregate data with pandas
  • Validate data before it reaches your warehouse
  • Design idempotent loads that are safe to re-run
  • Add logging and retries so failures are visible and recoverable

How this course is taught.

Every module comes to you in four parts, so you can watch, read, discuss and check what you have learned.

  1. Quadrant I

    e-Tutorial

    Watch a short video lecture for each module, with full text notes beside it so you can review or translate at your own pace.

  2. Quadrant II

    e-Content

    Download or print the reading material for each module, with key terms, case studies and links to further resources.

  3. Quadrant III

    Discussion forum

    Ask questions and clear your doubts with other learners. The course team guides the discussion and answers questions.

  4. Quadrant IV

    Assessment

    Check your understanding with quizzes, short and long-answer practice and FAQs.

Curriculum.

3 modules · 10 lessons
1Python foundations for pipelines3 lessons · 47 minProject structure, safe file handling and dates that mean what you think they mean.e-Tutorial (video)1e-Content (notes)2
  • Note: Structuring a pipeline project15 min
  • Video: Reading files safely with context managers14 min
  • Note: Working with dates and time zones18 min
2Transforming data with pandas4 lessons · 1 h 10 minClean, combine and validate data before it reaches anyone's dashboard.e-Tutorial (video)1e-Content (notes)2Assessment1
  • Note: Cleaning data with pandas22 min
  • Video: Joins and aggregations in pandas20 min
  • Note: Validating data before you load it18 min
  • Quiz: Check your understanding: Python and pandas10 min
3Reliable pipelines3 lessons · 3 h 40 minLoads you can re-run, failures you can see, and the final project.e-Tutorial (video)1e-Content (notes)1Assessment1
  • Note: Idempotent loads and upserts22 min
  • Video: Logging, retries and alerting18 min
  • Assignment: Project: build an idempotent CSV-to-database loader3 h

Before you start.

  • Basic Python: functions, lists, dictionaries and loops
  • Python 3.11 or later installed on your computer
  • Some familiarity with SQL

About this course.

Writing a script that works once is easy. Writing a pipeline that runs every night for a year, survives bad input and can be re-run after a failure without creating duplicates is a different skill. This programme teaches that skill.

Who it is for

Analysts and junior engineers who can write basic Python and want to move from notebooks to dependable pipelines.

What you will build

Over three modules you will structure a pipeline project, clean and validate data with pandas, and load it into a database idempotently. The final project is a CSV-to-database loader with logging and retries, reviewed by your instructor.

Tools

Python 3.12, pandas, SQLAlchemy and the standard library. Everything runs on a laptop; no cloud account is needed.

Your instructor.

Priya RamanSenior data engineer

Priya builds data pipelines and analytics platforms, and teaches SQL, Python and reporting with one priority: numbers people can trust.

Learner reviews.

No reviews yet

No reviews yet. Learners can review a course after completing half of it.

Questions about enrolling.

How long can I access this course?

You can access the course for 365 days from the day you enrol.

Is my payment secure?

Yes. Your card, UPI or bank details go straight to Razorpay. Walnut Data Tech never sees or stores them.

When do I get access?

Immediately after the payment is confirmed. You'll also get a receipt by email.

What if the payment fails but money is deducted?

This is usually a delay at the bank. If the payment is confirmed, you're enrolled automatically. If not, the bank reverses the amount, normally within 5–7 working days. Contact support with your receipt number if you need help.

Can I get a refund?

Yes, if you ask within 7 days of purchase and have completed less than 20% of the course. Raise a ticket from the help desk with your receipt number.

Data and analytics