References for: assertion
Full identifier: https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion
| Nanopublication | Part | Subject | Predicate | Object | Published By | Published On |
|---|---|---|---|---|---|---|
|
links a nanopublication to its assertion
http://www.nanopub.org/nschema#hasAssertion
assertion
|
assertion
|
interdisciplinary
|
Sensenets
|
2024-09-05T18:07:39.354Z
|
||
|
links a nanopublication to its assertion
http://www.nanopub.org/nschema#hasAssertion
assertion
|
assertion
|
feedbackplatform
|
Sensenets
|
2024-09-05T18:07:39.354Z
|
||
|
links a nanopublication to its assertion
http://www.nanopub.org/nschema#hasAssertion
assertion
|
assertion
|
LLMs
|
Sensenets
|
2024-09-05T18:07:39.354Z
|
||
|
links a nanopublication to its assertion
http://www.nanopub.org/nschema#hasAssertion
assertion
|
assertion
|
humanfeedback
|
Sensenets
|
2024-09-05T18:07:39.354Z
|
||
|
links a nanopublication to its assertion
http://www.nanopub.org/nschema#hasAssertion
assertion
|
assertion
|
Sensenets
|
2024-09-05T18:07:39.354Z
|
|||
|
links a nanopublication to its provenance
http://www.nanopub.org/nschema#hasProvenance
provenance
|
assertion
|
Sensenets
|
2024-09-05T18:07:39.354Z
|
|||
|
links a nanopublication to its provenance
http://www.nanopub.org/nschema#hasProvenance
provenance
|
assertion
|
Sensenets
|
2024-09-05T18:07:39.354Z
|
|||
|
links a nanopublication to its assertion
http://www.nanopub.org/nschema#hasAssertion
assertion
|
assertion
|
Human feedback is critical for aligning LLMs, so why don’t we collect it in the open ecosystem?🧐
We (15 orgs) gathered the key issues and next steps.
Envisioning
a community-driven feedback platform, like Wikipedia
https://www.alphaxiv.org/abs/2408.16961
🧵 https://twitter.com/LChoshen/status/1831708316982231235/photo/1
We define 5 axes of openness:
Methodology (how its collected)
Access (who can use it)
Models (onemany)
Contributors (as diverse as its uses?)
Time (keeps updating? closed models improve over several feedback iterations, and of course, models change)
Is current feedback open?🥶 https://twitter.com/LChoshen/status/1831708319855362549/photo/1
In our paper, we first learn from peer production efforts like wiki and stack overflow. These case studies tell us how important it is to align incentives of different bodies, allow the community to dictate the policies, etc.
Then, we hone on 6 crucial areas to develop open human feedback ecosystems:
Incentives to contribute, reducing contribution efforts, getting expert and diverse feedback, ongoing dynamic feedback, privacy and legal issues. https://twitter.com/LChoshen/status/1831708324284522965/photo/1
We believe a successful ecosystem must center around feedback loops
where anyone can spin up a community model, for storytelling, Bengali or anything else
Others can use it, give feedback, and benefit from a model that keeps improving with the contributions https://twitter.com/LChoshen/status/1831708326717161683/photo/1
The feedback from all models will be open and collected in one pool,
helping beyond the specialized models created to future research and general improvement
This was a huge effort and the paper is packed with ideas thanks to:
#deepRead
@Shachar_Don @ben_burtenshaw @RamonAstudill12 @cailean_osborne @MimansaJ @tzushengkuo @wzhao_nlp @IdanShenfeld @TheAndiPenguin @Yurochkin_M @Dr_Atoosa @YangsiboHuang @tatsu_hashimoto @YJernite @dvilasuero @AbendOmri @jen_gineered @sarahookr @hannahrosekirk
Note, we don't only preach open, this was open with contributions from so many organizations
@CohereForAI @MITIBMLab @IBMResearch @huggingface @nlphuji @UniofOxford @MIT_CSAIL @StanfordHAI @turinginst @princeton_nlp
@cmuhcii @EdinburghUni @cornell_tech
Please ask us anything, share, discuss and talk to us, we are going to make it real! Together!
Much much more in the paper:
https://www.alphaxiv.org/abs/2408.16961
|
Sensenets
|
2024-09-05T18:07:39.354Z
|
||
|
links a nanopublication to its assertion
http://www.nanopub.org/nschema#hasAssertion
assertion
|
assertion
|
openecosystem
|
Sensenets
|
2024-09-05T18:07:39.354Z
|
||
|
links a nanopublication to its assertion
http://www.nanopub.org/nschema#hasAssertion
assertion
|
assertion
|
Sensenets
|
2024-09-05T18:07:39.354Z
|
|||
|
links a nanopublication to its assertion
http://www.nanopub.org/nschema#hasAssertion
assertion
|
assertion
|
Sensenets
|
2024-09-05T18:07:39.354Z
|
|||
|
links a nanopublication to its assertion
http://www.nanopub.org/nschema#hasAssertion
assertion
|
assertion
|
Sensenets
|
2024-09-05T18:07:39.354Z
|
|||
|
links a nanopublication to its provenance
http://www.nanopub.org/nschema#hasProvenance
provenance
|
assertion
|
Sensenets
|
2024-09-05T18:07:39.354Z
|
|||
|
links a nanopublication to its provenance
http://www.nanopub.org/nschema#hasProvenance
provenance
|
assertion
|
Sensenets
|
2024-09-05T18:07:39.354Z
|
|||
|
links a nanopublication to its assertion
http://www.nanopub.org/nschema#hasAssertion
assertion
|
assertion
|
deepRead
|
Sensenets
|
2024-09-05T18:07:39.354Z
|
||
|
links a nanopublication to its provenance
http://www.nanopub.org/nschema#hasProvenance
provenance
|
assertion
|
Sensenets
|
2024-09-05T18:07:39.354Z
|
|||
|
links a nanopublication to its assertion
http://www.nanopub.org/nschema#hasAssertion
assertion
|
assertion
|
communitydriven
|
Sensenets
|
2024-09-05T18:07:39.354Z
|