-
Notifications
You must be signed in to change notification settings - Fork 1
feat(ai): ai 서버 구현 #42
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Open
pizzazoa
wants to merge
16
commits into
develop
Choose a base branch
from
feat/ai-server
base: develop
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
1차 시도는 랭체인의 장점을 살리기 위해 with_structured_output을 썼고, 2차 fallback 시도는 제미나이에서 가끔 실패하는 구조화(약5%)를 대비해 직접 템플릿 파싱하는 방식으로 구현했습니다.
Collaborator
|
GCP 사용은 좋습니다. |
Owner
Author
그럼 'ai 서버를 따로 두자'로 결정되면 이 pr은 닫아버리고 새 리포를 파도록 하겠습니다! |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
📝 요약(Summary)
ai 요약 서비스를 추후 확장 및 변경하기 쉽게 ai 서버를 따로 두고자 합니다. 이에 따라 ai 폴더를 따로 만들었습니다.
main 브랜치 병합 시에는 ai 폴더가 제외되어 따로 배포가 가능하도록 설계했습니다.
기존 자바 기반 ai 호출 서비스에서 파이썬 기반 ai 호출 서비스로 전환하는 변경입니다.
장점
단점
🔗 Related Issue
💬 공유사항
@1Seob
위 장단점을 보고 의견 남겨주세요.
참고로 ai 서버를 분리할 경우, stateless 환경은 aws 람다보다 구글의 cloudrun이 더 나은 성능을 보여 gcp에서 compute engine + cloudRun 조합이 나을 수 있습니다. 여기에 모델까지 gemini로 가게 되면 더더욱 gcp가 나을 수 있습니다.
ai 서버를 분리하지 않을 경우엔 지난 번에 얘기 나온대로 aws로 이전하는 걸 고려할 수 있습니다.
✅ PR Checklist
PR이 다음 요구 사항을 충족하는지 확인하세요.