𝐂𝐡𝐞𝐜𝐤 𝐨𝐮𝐭 𝐭𝐡𝐢𝐬 #𝐃𝐫𝐨𝐧𝐞 🚁👀
Joshua Bird built this drone ($20) in his dorm! 🤯
[open-source motion capture system⬇️]
Built at low cost, a motion capture system for tracking & and flying drones autonomously, with millimeter-level precision at room-scale.
The student used $1 PS3 Eye cameras 📷 with 150fps capability.
🔧 The challenge?
PID tuning! It took him 4 days of crashes to get the drone to hover, but it's still wobbly.
Used a 3x nested PID loop for precise control.
📚 This project led to his dissertation on visual SLAM!
🎥 Full details - Algorithms for camera positioning & obstacle triangulation, in his YouTube video: https://t.co/bDJvUpNJVq
Code & 3D files on GitHub: https://t.co/90W456CvP4
More projects at https://t.co/OZuxcF4VUM
If you have interesting papers or projects, you would like to share, please DM me!
•
•
•
•
----------------------------------------------------------
🚀 Scaling Deep Tech Startups: https://t.co/wwizBPyzF0
🎙 Robotics Podcast: https://t.co/d6kZld5Jxn
🔥🚨BREAKING: Joe Biden just confirmed that he only takes questions from a pre-approved list of journalists.
Biden: “I’ll take your questions, I’ve been given a list of people to call on here.”
New essay: ML seems to promise discovery without understanding, but this is fool's gold that has led to a reproducibility crisis in ML-based science. https://t.co/UrHbAsdSz0 (with @sayashk).
In 2021 we compiled evidence that an error called leakage is pervasive in ML models across scientific fields. In our most recent survey the number of affected fields has climbed to 30. https://t.co/mjy8TfKA4U
Leakage is only one of many reasons for reproducibility failures. There are widespread shortcomings in every step of ML-based science, from data collection to preprocessing and reporting results. https://t.co/hFhvM1rSHl
Root causes
The reasons for pre-ML replication crises, such as publication bias, also apply to ML. But a new and important reason for the poor quality of ML-based science is pervasive hype, resulting in the lack of a skeptical mindset among researchers, which is a cornerstone of good scientific practice.
We’ve observed that when researchers have overoptimistic expectations, and their ML model performs poorly, they assume that they did something wrong and tweak the model, when in fact they should strongly consider the possibility that they have run up against inherent limits to predictability. Conversely, they tend to be credulous when their model performs well, when in fact they should be on high alert for leakage or other flaws. And if the model performs better than expected, they assume that it has discovered patterns in the data that no human could have thought of, and the myth of AI as an alien intelligence makes this explanation seem readily plausible.
This is a feedback loop. Overoptimism fuels flawed research which further misleads other researchers in the field about what they should and shouldn’t expect AI to be able to do. https://t.co/UrHbAsdSz0
Glimmers of hope
Researchers should in principle be able to download a paper’s code and data, review it, and check whether they can reproduce the reported results. And the vast majority of errors can be avoided if the researchers know what to look out for. So we think that the problem can be greatly mitigated by a culture change where researchers systematically exercise more care in their work and reproducibility studies are incentivized.
We have led a few efforts to change this. First, our leakage paper has had an impact. Many researchers have used it to avoid leakage in their own work and to check previously published work. https://t.co/u2eJayGky9
Beyond leakage, we led a group of 19 researchers across computer science, data science, social sciences, mathematics, and biomedical research to develop the REFORMS checklist for ML-based science. It is a 32-item checklist that can help researchers catch eight kinds of common pitfalls in ML-based science. It was recently published in Science Advances. Of course, checklists by themselves won’t help if there isn’t a culture change, but based on the reception so far, we are cautiously optimistic. https://t.co/SWu8E6O4am
A tool, not a revolution
Of course, AI can be a useful tool for scientists. The key word is tool. AI is not a revolution. It is not a replacement for human understanding — to think so is to miss the point of science. AI does not offer a shortcut to the hard work and frustration inherent to research. AI is not an oracle and cannot see the future.
We are at an interesting moment in the history of science. Look at these graphs showing the adoption of AI in various fields (by Duede et al. https://t.co/pKhvCfzNnp):
These hockey stick graphs are not good news. They should be terrifying. Adopting AI requires changes to scientific epistemology. No scientific field has the capacity to accomplish this on a timescale of a couple of years. This is not what happens when a tool or method is adopted organically. It happens when scientists jump on a trend to get funding.
Given the level of hype, scientists don’t need additional incentives to adopt AI. That means AI-for-science funding programs are probably making things worse. We doubt the avalanche of flawed research can be stopped, but if at least a fraction of AI-for-science funding were diverted to better training, critical inquiry, meta-science, reproducibility, and other quality-control efforts, the havoc can be minimized.
https://t.co/UrHbAsdSz0
P. S. Our book AI Snake Oil is all about how to separate real AI advances from hype. It's now available to preorder (and we're told preordering makes a big difference to the book's success).
https://t.co/foQpEhRfhs
https://t.co/fHa32jM5Es
I had an amazing time presenting my work at the Modeling Estimation and Control Conference (MECC 2023).
1. SE(3) Koopman-MPC:
https://t.co/McsBW4048l
2. Off-Road Navigation Using Linear Transfer Operators (best robotics paper award): https://t.co/1Clno9mon3
@ClemsonCECAS
Introduce our #CoRL2023 (Oral) project:
"Robot Parkour Learning"
Using vision, our robots can climb over high obstacles, leap over large gaps, crawl beneath low barriers, squeeze through thin slits, and run. All done by one neural network running onboard.
And it's open-source!
#PhD student: Makes $30k a year. Works on weekends as well. Zero life-work balance.
"Do you think I have a chance to become a professor?"
Prof: "Yes, of course! Finish this project and we will publish excellent papers. I am sure you will easily find a faculty position."
▫️
2 years later:
Student finishes the project. Professor writes a report. Papers are published.
Student: "Do you think my CV is strong enough?"
Prof: "Yes, you are the best!"
▫️
Next 4 months:
Student submits 50 well-tailored applications for faculty positions.
Zero interviews. A lot of broken dreams.
▫️
Key takeaways:
1. Make sure you distinguish encouragement from reality.
- By encouraging you, your advisor may unintentionally give you too much hope. Keep a cool head.
2. Always ask other faculties for external opinion on your case.
- Your advisor’s opinion is always biased. Look for more input outside your group.
3. Don’t expect fairness during candidate selection.
- Hiring process is subjective by definition. It is done by people with very different views on who is the best. You may put tons of efforts into a research statement only to find out later that no one really reads it.
4. The reality is brutal.
- Departments can receive 300-500 candidates per opening. Many have excellent CVs and cool ideas. At top- and mid-rank universities, selection criteria can become extremely questionable (like, who exactly was your PhD advisor? Is your recomm. letter 3 pages long? etc).
And there is no need to say “You don’t know anything about it. It’s not like this���.
I went through this myself. Many times. Along with many colleagues.
Do not expect fairness. See luck as a big factor.
Apply broadly but have a backdoor ready.
#AcademicTwitter