Data Engineering Docs
=====================

Welcome to the Data Engineering team documentation.

.. grid:: 2
   :gutter: 3

   .. grid-item-card:: 🚀 Data Pipelines
      :link: pipelines/etl-pipeline
      :link-type: doc

      Complete documentation for all project pipelines.
   
   .. grid-item-card:: 📋 Guidelines
      :link: guidelines/coding-standards
      :link-type: doc

      Team coding standards and deployment guides.

   .. grid-item-card:: 📝 SQL Reference
      :link: sql/common-queries
      :link-type: doc

      Common SQL queries and optimization tips.

   .. grid-item-card:: 🐍 Python Code
      :link: python/data-processing
      :link-type: doc

      Reusable Python functions and utilities.




Architecture Overview
---------------------

.. mermaid::

   flowchart LR
       A[App Scripts] --> B[BigQuery]
       B --> C[LookerStudio]

       
       style A fill:#e1f5fe
       style B fill:#c8e6c9
       style C fill:#fff3e0


Quick Start
-----------

.. code-block:: bash

   # Clone and setup
   git clone https://github.com/prashanthkadasi/pi-docs.git
   cd pi-docs
   pip install -r requirements.txt
   
   # Build docs
   make html


.. toctree::
   :maxdepth: 2
   :caption: Data Pipelines
   :hidden:

   pipelines/etl-pipeline
   pipelines/data-ingestion
   pipelines/playstation
   pipelines/dubai-basketball
   pipelines/brands
   pipelines/news-economy
   pipelines/ai

.. toctree::
   :maxdepth: 2
   :caption: SQL Reference
   :hidden:

   sql/common-queries
   sql/optimization-tips

.. toctree::
   :maxdepth: 2
   :caption: Python Reference
   :hidden:

   python/data-processing
   python/api-reference

.. toctree::
   :maxdepth: 2
   :caption: Guidelines
   :hidden:

   guidelines/coding-standards
   guidelines/deployment

.. toctree::
   :maxdepth: 2
   :caption: Getting Started
   :hidden:

   getting-started/overview
   getting-started/setup