Skip to content

Modify mitxonline ETL to ingest designated programs as courses#3013

Open
mbertrand wants to merge 3 commits intomainfrom
mb/program_2_course
Open

Modify mitxonline ETL to ingest designated programs as courses#3013
mbertrand wants to merge 3 commits intomainfrom
mb/program_2_course

Conversation

@mbertrand
Copy link
Member

@mbertrand mbertrand commented Mar 4, 2026

What are the relevant tickets?

Depends on https://github.com/mitodl/hq/issues/10405

Closes https://github.com/mitodl/hq/issues/10416

Description (What does it do?)

  • Refactors the MITx Online to ingest certain programs as courses
  • Adds a "Program as Course" resource tag to these resources.
  • Puts it behind a feature flag because the product page for a program->course likely won't work right yet (until https://github.com/mitodl/hq/issues/10429 is implemented)

How can this be tested?

  • Log in to posthog and verify that the progam-to-course feature flag for the MITLearn-RC project is currently rolled out to 0% of users
  • Set these env values in your backend.local.env file:
    MITX_ONLINE_BASE_URL=https://rc.mitxonline.mit.edu/
    MITX_ONLINE_COURSES_API_URL=https://rc.mitxonline.mit.edu/api/v2/courses/
    MITX_ONLINE_PROGRAMS_API_URL=https://rc.mitxonline.mit.edu/api/v2/programs/
    
  • Set these to the same as RC in your shared.local.env file:
    POSTHOG_API_HOST=https://ph.ol.mit.edu
    POSTHOG_PERSONAL_API_KEY=
    POSTHOG_PROJECT_API_KEY=
    POSTHOG_PROJECT_ID=
    POSTHOG_ENABLED=True
    
  • Run docker compose run --rm web python manage.py backpopulate_mitxonline_data
  • Search for "Fundamentals of Deep Learning" - it should be returned as a program
  • Log back in to posthog and edit the prorgam-to-course feature flag so that it is rolled out to 100% of users
  • Wait a few minutes, then run the backpopulate again.
  • Redo the search, this time it should show up as a course. Open the drawer for the course, that should still work.
  • Set the feature flag back to 0% of users in posthog.

@github-actions
Copy link

github-actions bot commented Mar 6, 2026

OpenAPI Changes

Show/hide No detectable change.

Unexpected changes? Ensure your branch is up-to-date with main (consider rebasing).

@mbertrand mbertrand force-pushed the mb/program_2_course branch from ba7e092 to 965e7f6 Compare March 11, 2026 13:30
@mbertrand mbertrand added Needs Review An open Pull Request that is ready for review and removed Blocked labels Mar 11, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Needs Review An open Pull Request that is ready for review

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant