S
Salesforce Research Blog
blog.einstein.ai · Company blog · on HN since 2018
Salesforce's AI research team posts about its work on language models, code models, reinforcement learning, and the AI Economist.
What HN saysHN links it for project details on CTRL, CodeT5, text-to-SQL, and the AI Economist; one commenter found the text-to-SQL results weaker than hoped.
25HN people shared it
6linked it in comments
20stories submitted
113story points
5 years agolast shared
2018people per year2026
Most-shared posts
- 1Improving Equality and Productivity with AI-Driven Tax Policies9 people · 21 points · first shared 2020 · 1 comments on HN
- 2A Conditional Transformer Language Model for Controllable Generation4 people · 6 points · first shared 2019 · 1 comments on HN
- 3Talk to Your Data: One Model, Any Relational Database2 people · 67 points · first shared 2020 · 18 comments on HN
- 4CodeT5: Code-Aware Encoder-Decoder Based Pre-Trained Programming Language Models2 people · 4 points · first shared 2021 · discussion on HN
- 5Benchmarking Triton (TensorRT) Inference Server for Transformer Models1 people · 3 points · first shared 2020 · discussion on HN
- 6How to talk to your database1 people · 2 points · first shared 2018 · discussion on HN
- 7WarpDrive: Extremely Fast Reinforcement Learning on an Nvidia GPU1 people · 2 points · first shared 2021 · discussion on HN
- 8ProGen: Using AI to Generate Proteins1 people · 2 points · first shared 2020 · discussion on HN
- 9GeDi: A Powerful New Method for Controlling Language Models1 people · 2 points · first shared 2020 · discussion on HN
- 10(Re)Discovering Protein Structure and Function Through Language Modeling1 people · 1 points · first shared 2020 · 1 comments on HN
- 11Open Source AI for Economic Policy Recommendations1 people · 1 points · first shared 2020 · 5 comments on HN
- 12AI language model designs functional artificial proteins1 people · 1 points · first shared 2021 · discussion on HN
- 13Explaining Solutions to Physical Reasoning Tasks Using AI1 people · 1 points · first shared 2020 · discussion on HN
What HN people wrote when they linked it
ipsum2 · 2020-07-04
That's what CTRL does:
Given a URL (or other prompt), generate some language.
From [1]:
> With CTRL, we can test which domain best explains a sequence. Note that this procedure is sensitive to subtle nuances in the query prompt. In the example below, "Global warming is a lie" differs from "Global warming is a lie." The latter is a simple declarative sentence as opposed to an open start to a sentence which may continue. Source attribution cannot be considered a measure of veracity, but only a measure of how much each domain token explains a given sequence.
Query Prompt Attributed Sources
Global warming is a lie. r/unpopularopinion, r/conspiracy, r/science
Global warming is a lie r/eli5, r/science, r/unpopularopinion
Global warming is a real phenomenon r/eli5, r/science, r/changemyview
Global warming is a real phenomenon. OpenWebText, r/changemyview, r/science
https://blog.einstein.ai/introducing-a-conditional-transformer-languag…
panabee · 2021-09-10
related links:
* (code is open-source) https://github.com/salesforce/CodeT5
* https://blog.einstein.ai/codet5/
Detrus · 2021-05-13
Maybe works in 10% of cases.
I remember seeing a natural language to SQL engine which worked in 50% of cases so the expectation was higher. https://blog.einstein.ai/talk-to-your-data-one-model-any-database/
adolph · 2020-10-07
The article seems link free but the below seem to be related to the project.
https://blog.einstein.ai/the-ai-economist/
https://einstein.ai/the-ai-economist
https://github.com/salesforce/ai-economist
[edit: Sarcasm removed. I think the project is exciting. I don't think the stated value of data/ML being fairer than politics is very strong because (a.) politics is reflective of culture and represents a sophisticated method of developing consensus among many different ideas of what fair means, (b.) tax accounting work will just shift to GAN and the end result won't be much different just more complex.]
GAN https://en.wikipedia.org/wiki/Generative_adversarial_network
ipnon · 2020-08-19
AI researchers are important for this reason. Super intelligence, even if limited to simulations, can find results outside of the mainstream that are more optimal than the economic convention.[1]
[1] https://blog.einstein.ai/the-ai-economist/
sthottingal · 2019-09-16
Here is an example for a very recent progress in language model which does not mention the language name at all:
"CTRL - A Conditional Transformer Language Model for Controllable Generation" -
https://blog.einstein.ai/introducing-a-conditional-transformer-languag…
As a researcher in a non-english, morphologically rich language, I completely agree with the article by Emily Bender. Everytime I read papers, when people ask questions or discuss on NLP in various forums such as reddit/stackoverlow, the language name is taken for granted as English.