@jobergum I played around with Jina a bit earlier this year. It’s mostly a framework for query and document processing. You need a database or search engine behind it.
TIL: AWS ECS Fargate tasks triggered by EventBridge rules may fail despite the rule saying successful invocation. If so, the only way to detect this is to listen to the 'ECS Task State Change' event with stopCode TaskFailedToStart.
@loretoparisi@jobergum@vitojph QueueProcessingFargateService might be the best serverless solution in AWS. With larger models, the startup time for Sagemaker is horrible. Startup time is also high for Fargate, but the queue and scaling based on queue size is better than Sagemaker scaling.