Linkedin scrapper fixes

.github/workflows/linkedin-scrapper.yaml

@@ -0,0 +1,53 @@
+name: Run LinkedIn Scraper
+
+on:
+  schedule:
+    - cron: '0 0 */2 * *'
+  workflow_dispatch:
+  push:
+
+jobs:
+  scrape_and_commit:
+    runs-on: ubuntu-latest
+
+    steps:
+      - name: Checkout repository
+        uses: actions/checkout@v3
+        with:
+          fetch-depth: 0
+
+      - name: Set up Python 3.12
+        uses: actions/setup-python@v3
+        with:
+          python-version: "3.12"
+
+      - name: Install dependencies
+        run: |
+          python -m pip install --upgrade pip
+          pip install -r scripts/linkedin-scraper/requirements.txt
+
+      - name: Create cookies.json from secret
+        run: |
+          echo '${{ secrets.LINKEDIN_COOKIES_JSON }}' > ./scripts/linkedin-scraper/cookies.json
+
+      - name: List matching YAML files
+        run: |
+          echo "Found the following C20xx files in public/department/Extras/Classes (random order):"
+          ls public/department/Extras/Classes/ | grep -E '^C20[0-9]{2}(_Credit)?\.yaml$' | shuf
+
+
+      - name: Run LinkedIn scraper for one random class YAML file
+        run: |
+          set -e
+          file=$(find public/department/Extras/Classes/ -maxdepth 1 -type f \( -name 'C20[0-9][0-9]_Credit.yaml' -o -name 'C20[0-9][0-9].yaml' \) | shuf -n 1)
+          echo "Running scraper for $file"
+          python scripts/linkedin-scraper/final_linkedin_script.py "$file" || echo "Error running scraper for $file, continuing..."
+
+
+      - name: Commit and push changes
+        run: |
+          git config --global user.name "GitHub Actions"
+          git config --global user.email "actions@github.com"
+          git add -A
+          git diff --cached --quiet || git commit -m "chore: update LinkedIn profiles and summaries"
+          git push

.gitignore

@@ -4,7 +4,7 @@
 /node_modules
 /.pnp
 .pnp.js
-
+cookies.json
 # testing
 /coverage
 

public/department/Extras/Classes/C2024_Credit.yaml

@@ -103,9 +103,10 @@
       linkedin_url: https://www.linkedin.com/in/habiba-hassan-elhussieny-815988231
       markdown: You can know more about Habiba and reach her out by visiting her [LinkedIn]()
         and [GitHub](https://github.com/HabibaHassan02) profile.
-      title: Fresh Graduate | Computer Engineer
-      top_skills: null
-      current_position: null
+      title: 'Software Engineer '
+      top_skills: NumPy, TensorFlow, PyTorch, Game Development
+      current_position: Software Engineer, Edafa Telecom Solutions · Aug 2023 - Present
+        10 mos
     - name: Hossam Nabeil
       image: null
       markdown: This is one fantastic CCEC student
@@ -114,12 +115,12 @@
       top_skills: null
       current_position: null
     - name: Khaled Mamdouh
-      image: https://media.licdn.com/dms/image/v2/D4D35AQHDhv-nvKF1vQ/profile-framedphoto-shrink_200_200/profile-framedphoto-shrink_200_200/0/1725544612384?e=1726992000&v=beta&t=j0HETKgKg6rUncflrThvCsZTfseWk5hZQJuWXZKQSOs
+      image: https://media.licdn.com/dms/image/v2/C4D03AQFs7ESzlXCQTQ/profile-displayphoto-shrink_200_200/profile-displayphoto-shrink_200_200/0/1635702211865?e=1756339200&v=beta&t=cbXJaLnkN3bgI_zaorAHsxP04lKBfsOQdk2MxVWwRhg
       linkedin_url: https://www.linkedin.com/in/khalidmamdou7/
       markdown: You can know more about Khaled and reach him out by visiting his [LinkedIn]()
         and [GitHub](https://github.com/khalidmamdou7) profile.
-      title: Computer Engineering Graduate of Cairo University
-      top_skills: null
+      title: Software Engineer
+      top_skills: Argo, Amazon Web Services (AWS), Microsoft SQL Server, Teaching
       current_position: null
     - name: Donia Remah
       image: null

public/department/Extras/Classes/C2024_Credit_ar.yaml

@@ -101,9 +101,10 @@
       linkedin_url: https://www.linkedin.com/in/habiba-hassan-elhussieny-815988231
       markdown: يمكنك معرفة المزيد عن حبيبة والتواصل معها عبر زيارة [صفحتها على LinkedIn]()
         و[GitHub](https://github.com/HabibaHassan02).
-      title: Fresh Graduate | Computer Engineer
-      top_skills: null
-      current_position: null
+      title: 'Software Engineer '
+      top_skills: NumPy, TensorFlow, PyTorch, Game Development
+      current_position: Software Engineer, Edafa Telecom Solutions · Aug 2023 - Present
+        10 mos
     - name: حسام نبيل
       image: null
       markdown: طالب/ة في قسم الحاسبات بنظام الساعات المعتمدة
@@ -112,12 +113,12 @@
       top_skills: null
       current_position: null
     - name: خالد ممدوح
-      image: https://media.licdn.com/dms/image/v2/D4D35AQHDhv-nvKF1vQ/profile-framedphoto-shrink_200_200/profile-framedphoto-shrink_200_200/0/1725544612384?e=1726992000&v=beta&t=j0HETKgKg6rUncflrThvCsZTfseWk5hZQJuWXZKQSOs
+      image: https://media.licdn.com/dms/image/v2/C4D03AQFs7ESzlXCQTQ/profile-displayphoto-shrink_200_200/profile-displayphoto-shrink_200_200/0/1635702211865?e=1756339200&v=beta&t=cbXJaLnkN3bgI_zaorAHsxP04lKBfsOQdk2MxVWwRhg
       linkedin_url: https://www.linkedin.com/in/khalidmamdou7/
       markdown: يمكنك معرفة المزيد عن خالد والتواصل معه عبر زيارة [صفحته على LinkedIn]()
         و[GitHub](https://github.com/khalidmamdou7).
-      title: Computer Engineering Graduate of Cairo University
-      top_skills: null
+      title: Software Engineer
+      top_skills: Argo, Amazon Web Services (AWS), Microsoft SQL Server, Teaching
       current_position: null
     - name: دنيا رماح
       image: null