Hyper-parameters are tricky to dial in for optimal performance. Luckily we can build on existing benchmarks that match closely with the task we care about for parameter value selection.
To contribute to the community's understanding @DefinitiveIO is releasing a highly multi-threaded HumanEval based pass@1 benchmark across temperature/top_p parameters.
Should be easy to adapt to your context and could directly inform your parameter choices if you're doing instruction guided code generation. Fully OSS, check it out here 👇️
https://t.co/Ka5dHjtlm9
h/t to @OpenAI for making HumanEval and open-sourcing it.
🚨 We've been working on something very exciting at @DefinitiveIO and I can finally show it to you: https://t.co/AHqLzbtxPW
Code Indexer Loop: a fully automated vector based indexer for your source code
Apache 2.0, continuous code chunking, embeddding & indexing, based on @llama_index, @langchain, @trychroma, and tree-sitter.
Since the Ford government was elected in 2018, developers paid millions for properties the gov't now wants to carve out of the Greenbelt, latest from @moore_oliver + me #onpoli https://t.co/fp76t11iTK
“According to a statement from city staff, planning for the park upgrades, which began in 2015, ‘pre-dated discussions around introducing more year-round washroom facilities’”
Ah yes, ancient era of 2015, when no one had realized need for winter washrooms https://t.co/cT66vItvEn
"there’s nothing pedestrians can do to ensure their safety on streets. Walkers are at the mercy of motorists. The only way to keep pedestrians safe is to drive more safely and design safer streets"
https://t.co/mhVDAGnppC
Elderly man struck down on Warden. Driver flees scene knowing man hit and likely dying. Dies days later. Driver charged criminal hit and run and careless. Pleads down to HTA hit and run. Other charges with drawn. Gets 1000 fine, no suspension. Our system.
“The propulsion system ... is irrelevant. What is relevant is that any car of any technology takes up public space that should be devoted to people. For cities, EVs are not the future; they already belong in the past, along with gasoline and diesel cars”
https://t.co/04GnjgGSmA
GO Transit ridership for April to September 2020 was just 7.6% of previous year.
Line by line:
Lakeshore East: 9.4%
Lakeshore West: 8.2%
Kitchener: 6.7%
UP Express: 5.9%
Barrie: 5.1%
Stouffville: 3.8%
Milton: 2.7%
Richmond Hill: 1.5%
https://t.co/Qk2djnqZIj
I can’t stop thinking, as I read today’s @globeandmail stories of cities reinventing themselves to prioritize people over cars, that Toronto is spending 44% of its capital budget until 2030 to rebuild 2 kms of an expressway that does the exact opposite. #Gardiner#topoli
Toronto's fire chief clarifies that resto/bar patios must have "at least two full sides" open to the outdoors. That means a load of downtown patios are not compliant and are, effectively, indoor spaces