{"id":"4f5fd43b5d2e347d5df1dd8aa2d97ee3422974769ba0a9c46202fe1d98f1c2e4","title":"arXiv cs.AI: Researchers adapt LLM-SC for Pashupatinath Temple reviews","argument":"Pujan Pant, Sagar Newpane, Hari Sitaula and Manish Sakhakarmy adapt the LLM-Social Computing (LLM-SC) framework to visitor reviews of Pashupatinath Temple in Nepal. They argue generic extraction schemes may miss rituals, sacred spaces, cultural restrictions and emotionally mixed experiences at living sacred heritage sites. Their GPT-4o extraction prompt uses a 12-type entity taxonomy, four relation types and nine aspect-sentiment dimensions; eight entity types are specific to sacred heritage. The authors apply it to a fixed random sample of 2,500 English-language Tripadvisor reviews from a processed corpus of 3,939.\n\nAgainst an adjudicated two-annotator reference for 200 reviews, exact normalized surface-and-type matching gave provisional entity micro-F1 of 28.4%. Aspect-presence F1 was 53.6%, and end-to-end aspect-plus-polarity F1 was 42.6%. Human adjudication supported 78.9% of first-listed relation candidates, one per review; the authors caution that this candidate-level rate does not estimate relation recall or whole-graph precision.\n\nThe paper presents a culturally grounded adaptation with component-wise human evaluation, while identifying reproducibility and generalization limitations. The reported scores are provisional and assess particular extraction components; they do not establish how well the approach generalizes beyond the study’s reviews.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The reported entity scores are provisional and use exact normalized surface-and-type matching against an adjudicated reference for 200 reviews. The source evaluates a fixed random sample of English-language Tripadvisor reviews about one temple; the excerpt does not report results for other languages or sites. The relation-candidate support rate does not estimate relation recall or whole-graph precision. The source names reproducibility and generalization limitations but the supplied abstract does not detail them.","speaker":{"name":"Pant, Pujan, Newpane, Sagar, Sitaula, Hari, Sakhakarmy, Manish","roleAtSource":"Article author"},"source":{"title":"Adapting LLM-SC to Living Sacred Heritage: Domain-Specific Extraction, Semantic Networks and Human Evaluation on Pashupatinath Temple Reviews","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2610.35685","publishedAt":"2026-10-26","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors argue that generic extraction schemes may miss features of living sacred heritage sites, and adapt LLM-SC for Pashupatinath Temple reviews.","excerpt":"generic schemes may miss rituals, sacred spaces, cultural restrictions and emotionally mixed experiences at living sacred heritage sites. We adapted the LLM-Social Computing (LLM-SC) framework to Pashupatinath Temple","url":"https://arxiv.org/abs/2610.35685","relationship":"Source-stated"},{"text":"The adaptation uses 12 entity types, four relation types and nine aspect-sentiment dimensions, including eight added sacred-heritage types.","excerpt":"a 12-type entity taxonomy (four original LLM-SC types plus eight sacred-heritage types), four relation types and nine aspect-sentiment dimensions","url":"https://arxiv.org/abs/2610.35685","relationship":"Source-stated"},{"text":"The authors applied the extraction prompt to a fixed random sample of 2,500 English-language Tripadvisor reviews from a processed corpus of 3,939.","excerpt":"applied to a fixed random sample of 2,500 English-language Tripadvisor reviews from a processed corpus of 3,939","url":"https://arxiv.org/abs/2610.35685","relationship":"Source-stated"},{"text":"Against an adjudicated two-annotator reference for 200 reviews, entity micro-F1 was 28.4%, aspect-presence F1 was 53.6%, and end-to-end aspect-plus-polarity F1 was 42.6%.","excerpt":"exact normalized surface-and-type matching gave provisional entity scores of 41.0% precision, 21.8% recall and 28.4% micro-F1. Aspect-presence F1 was 53.6% and end-to-end aspect-plus-polarity F1 was 42.6%.","url":"https://arxiv.org/abs/2610.35685","relationship":"Source-stated"},{"text":"Human adjudication supported 78.9% of first-listed relation candidates, but that candidate-level rate does not estimate relation recall or whole-graph precision.","excerpt":"Human adjudication supported 153 of 194 first-listed relation candidates (one per review; 78.9%), a candidate-level rate that does not estimate relation recall or whole-graph precision.","url":"https://arxiv.org/abs/2610.35685","relationship":"Source-stated"},{"text":"The authors describe the contribution as a culturally grounded adaptation with component-wise human evaluation and explicit reproducibility and generalization limitations.","excerpt":"The contribution is a culturally grounded, domain-specific adaptation with component-wise human evaluation and explicit reproducibility and generalization limitations.","url":"https://arxiv.org/abs/2610.35685","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.35685","checkedAt":"2026-11-11T00:40:09.369Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How would the reported component scores change when evaluated on reviews beyond the 200 used for the adjudicated reference?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Researchers adapt LLM-SC for Pashupatinath Temple reviews","summary":"Pujan Pant, Sagar Newpane, Hari Sitaula and Manish Sakhakarmy adapt the LLM-Social Computing (LLM-SC) framework to visitor reviews of Pashupatinath Temple in Nepal. They argue generic extraction schemes may miss rituals, sacred spaces, cultural restrictions and emotionally mixed experiences at living sacred heritage sites. Their GPT-4o extraction prompt uses a 12-type entity taxonomy, four relation types and nine aspect-sentiment dimensions; eight entity types are specific to sacred heritage. The authors apply it to a fixed random sample of 2,500 English-language Tripadvisor reviews from a processed corpus of 3,939.\n\nAgainst an adjudicated two-annotator reference for 200 reviews, exact normalized surface-and-type matching gave provisional entity micro-F1 of 28.4%. Aspect-presence F1 was 53.6%, and end-to-end aspect-plus-polarity F1 was 42.6%. Human adjudication supported 78.9% of first-listed relation candidates, one per review; the authors caution that this candidate-level rate does not estimate relation recall or whole-graph precision.\n\nThe paper presents a culturally grounded adaptation with component-wise human evaluation, while identifying reproducibility and generalization limitations. The reported scores are provisional and assess particular extraction components; they do not establish how well the approach generalizes beyond the study’s reviews.","question":"How would the reported component scores change when evaluated on reviews beyond the 200 used for the adjudicated reference?","claims":[{"text":"The authors argue that generic extraction schemes may miss features of living sacred heritage sites, and adapt LLM-SC for Pashupatinath Temple reviews.","excerpt":"generic schemes may miss rituals, sacred spaces, cultural restrictions and emotionally mixed experiences at living sacred heritage sites. We adapted the LLM-Social Computing (LLM-SC) framework to Pashupatinath Temple","support":"source-stated"},{"text":"The adaptation uses 12 entity types, four relation types and nine aspect-sentiment dimensions, including eight added sacred-heritage types.","excerpt":"a 12-type entity taxonomy (four original LLM-SC types plus eight sacred-heritage types), four relation types and nine aspect-sentiment dimensions","support":"source-stated"},{"text":"The authors applied the extraction prompt to a fixed random sample of 2,500 English-language Tripadvisor reviews from a processed corpus of 3,939.","excerpt":"applied to a fixed random sample of 2,500 English-language Tripadvisor reviews from a processed corpus of 3,939","support":"source-stated"},{"text":"Against an adjudicated two-annotator reference for 200 reviews, entity micro-F1 was 28.4%, aspect-presence F1 was 53.6%, and end-to-end aspect-plus-polarity F1 was 42.6%.","excerpt":"exact normalized surface-and-type matching gave provisional entity scores of 41.0% precision, 21.8% recall and 28.4% micro-F1. Aspect-presence F1 was 53.6% and end-to-end aspect-plus-polarity F1 was 42.6%.","support":"source-stated"},{"text":"Human adjudication supported 78.9% of first-listed relation candidates, but that candidate-level rate does not estimate relation recall or whole-graph precision.","excerpt":"Human adjudication supported 153 of 194 first-listed relation candidates (one per review; 78.9%), a candidate-level rate that does not estimate relation recall or whole-graph precision.","support":"source-stated"},{"text":"The authors describe the contribution as a culturally grounded adaptation with component-wise human evaluation and explicit reproducibility and generalization limitations.","excerpt":"The contribution is a culturally grounded, domain-specific adaptation with component-wise human evaluation and explicit reproducibility and generalization limitations.","support":"source-stated"}],"limitations":["The reported entity scores are provisional and use exact normalized surface-and-type matching against an adjudicated reference for 200 reviews.","The source evaluates a fixed random sample of English-language Tripadvisor reviews about one temple; the excerpt does not report results for other languages or sites.","The relation-candidate support rate does not estimate relation recall or whole-graph precision.","The source names reproducibility and generalization limitations but the supplied abstract does not detail them."],"mediaId":"8e3e66eca8532ad7c7d61b425624424c3cd58c126ff558aeee24d09f5697774a","correctionReason":null,"id":"4f5fd43b5d2e347d5df1dd8aa2d97ee3422974769ba0a9c46202fe1d98f1c2e4","publicationId":"79fc4b63-39d5-4410-8787-ea9f626d4082","version":1,"sourceUrl":"https://arxiv.org/abs/2610.35685","sourceTitle":"Adapting LLM-SC to Living Sacred Heritage: Domain-Specific Extraction, Semantic Networks and Human Evaluation on Pashupatinath Temple Reviews","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-10-26","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-02T05:04:51.375Z","createdAt":"2026-11-11T00:09:56.003Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"8e3e66eca8532ad7c7d61b425624424c3cd58c126ff558aeee24d09f5697774a","kind":"article","url":"https://arxiv.org/abs/2610.35685","sourceUrl":"https://arxiv.org/abs/2610.35685","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-03T04:45:43.422Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.35685","checkedAt":"2026-11-11T00:40:09.369Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"8e3e66eca8532ad7c7d61b425624424c3cd58c126ff558aeee24d09f5697774a","confidence":0.55,"provider":"typesafe","model":"jev-1.13.0","inputHash":"34efccbcb7b2288f7e468f50af45eed8883f9d570256832ab040fa6e34aaea83","decidedAt":"2026-11-03T04:45:44.175Z","redecided":{"from":"stream-admission-v5","under":"stream-admission-v5+confidence-0.5"}},"provenance":{"textHash":"d8aa99fcd4a598be1b270374a4766d36368f3fa34f30bb3b9bcaac01faab1b04","observationId":"cf117bdec45704e2716cdfc93f3b8ca487aa33c429837262b33901fbd356e37c","retrievedAt":"2026-11-03T04:45:43.324Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"6bc2f61f-09ea-4117-83d3-8d45736b328b"},"reviewer":{"model":"gpt-6-luna","runId":"e7e77203-bf45-4a67-8ec1-ce9f3a1dfacc"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-11T00:09:56.003Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Pant, Pujan","url":null,"kind":"unknown"},{"name":"Newpane, Sagar","url":null,"kind":"unknown"},{"name":"Sitaula, Hari","url":null,"kind":"unknown"},{"name":"Sakhakarmy, Manish","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Pant, Pujan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Pant, Pujan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.35685","locator":"head/meta[name=author|citation_author]"},"assertionId":"b7bdfa2a5cb2bb85bc9fffa16541ec0ca777fcf33d820c2a38e0c166f433f83e:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-11T00:40:09.369Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"b7bdfa2a5cb2bb85bc9fffa16541ec0ca777fcf33d820c2a38e0c166f433f83e","sourceUrl":"https://arxiv.org/abs/2610.35685","contentSha256":"8a192a51e85574776d70300478203ac42ff3f4b6b1c66952273f6bcc71daa45f","textHash":"d8aa99fcd4a598be1b270374a4766d36368f3fa34f30bb3b9bcaac01faab1b04","observedAt":"2026-11-11T00:40:09.369Z"}},{"actor":{"name":"Newpane, Sagar","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Newpane, Sagar","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.35685","locator":"head/meta[name=author|citation_author]"},"assertionId":"b7bdfa2a5cb2bb85bc9fffa16541ec0ca777fcf33d820c2a38e0c166f433f83e:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-11T00:40:09.369Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"b7bdfa2a5cb2bb85bc9fffa16541ec0ca777fcf33d820c2a38e0c166f433f83e","sourceUrl":"https://arxiv.org/abs/2610.35685","contentSha256":"8a192a51e85574776d70300478203ac42ff3f4b6b1c66952273f6bcc71daa45f","textHash":"d8aa99fcd4a598be1b270374a4766d36368f3fa34f30bb3b9bcaac01faab1b04","observedAt":"2026-11-11T00:40:09.369Z"}},{"actor":{"name":"Sitaula, Hari","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Sitaula, Hari","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.35685","locator":"head/meta[name=author|citation_author]"},"assertionId":"b7bdfa2a5cb2bb85bc9fffa16541ec0ca777fcf33d820c2a38e0c166f433f83e:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-11T00:40:09.369Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"b7bdfa2a5cb2bb85bc9fffa16541ec0ca777fcf33d820c2a38e0c166f433f83e","sourceUrl":"https://arxiv.org/abs/2610.35685","contentSha256":"8a192a51e85574776d70300478203ac42ff3f4b6b1c66952273f6bcc71daa45f","textHash":"d8aa99fcd4a598be1b270374a4766d36368f3fa34f30bb3b9bcaac01faab1b04","observedAt":"2026-11-11T00:40:09.369Z"}},{"actor":{"name":"Sakhakarmy, Manish","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Sakhakarmy, Manish","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.35685","locator":"head/meta[name=author|citation_author]"},"assertionId":"b7bdfa2a5cb2bb85bc9fffa16541ec0ca777fcf33d820c2a38e0c166f433f83e:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-11T00:40:09.369Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"b7bdfa2a5cb2bb85bc9fffa16541ec0ca777fcf33d820c2a38e0c166f433f83e","sourceUrl":"https://arxiv.org/abs/2610.35685","contentSha256":"8a192a51e85574776d70300478203ac42ff3f4b6b1c66952273f6bcc71daa45f","textHash":"d8aa99fcd4a598be1b270374a4766d36368f3fa34f30bb3b9bcaac01faab1b04","observedAt":"2026-11-11T00:40:09.369Z"}}],"participationCoverage":{"total":4,"returned":4,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2610.35685","snapshotId":"b7bdfa2a5cb2bb85bc9fffa16541ec0ca777fcf33d820c2a38e0c166f433f83e","contentSha256":"8a192a51e85574776d70300478203ac42ff3f4b6b1c66952273f6bcc71daa45f","textHash":"d8aa99fcd4a598be1b270374a4766d36368f3fa34f30bb3b9bcaac01faab1b04","observedAt":"2026-11-11T00:40:09.369Z","basis":"publisher-page-metadata","sourceLinks":42,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/4f5fd43b5d2e347d5df1dd8aa2d97ee3422974769ba0a9c46202fe1d98f1c2e4/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-cs-ai-researchers-adapt-llm-sc-for-pashupatinath-temple-4f5fd43b","formats":{"html":"/readings/arxiv-cs-ai-researchers-adapt-llm-sc-for-pashupatinath-temple-4f5fd43b","markdown":"/readings/arxiv-cs-ai-researchers-adapt-llm-sc-for-pashupatinath-temple-4f5fd43b.md","json":"/readings/arxiv-cs-ai-researchers-adapt-llm-sc-for-pashupatinath-temple-4f5fd43b.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-llm","name":"Large language model","explanation":"A language model with many learned numerical settings, used to process and generate language.","referenceUrl":"https://developers.google.com/machine-learning/glossary#large-language-model"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"4f5fd43b5d2e347d5df1dd8aa2d97ee3422974769ba0a9c46202fe1d98f1c2e4","revision":"79fc4b63-39d5-4410-8787-ea9f626d4082","revisionKind":"publication-id","title":"arXiv cs.AI: Researchers adapt LLM-SC for Pashupatinath Temple reviews","url":"https://escapemeridian.com/readings/arxiv-cs-ai-researchers-adapt-llm-sc-for-pashupatinath-temple-4f5fd43b"},"source":{"type":"source","id":"https://arxiv.org/abs/2610.35685","revision":"d8aa99fcd4a598be1b270374a4766d36368f3fa34f30bb3b9bcaac01faab1b04","revisionKind":"sha256-source-text","title":"Adapting LLM-SC to Living Sacred Heritage: Domain-Specific Extraction, Semantic Networks and Human Evaluation on Pashupatinath Temple Reviews","url":"https://arxiv.org/abs/2610.35685"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"4f5fd43b5d2e347d5df1dd8aa2d97ee3422974769ba0a9c46202fe1d98f1c2e4","title":"arXiv cs.AI: Researchers adapt LLM-SC for Pashupatinath Temple reviews","argument":"Pujan Pant, Sagar Newpane, Hari Sitaula and Manish Sakhakarmy adapt the LLM-Social Computing (LLM-SC) framework to visitor reviews of Pashupatinath Temple in Nepal. They argue generic extraction schemes may miss rituals, sacred spaces, cultural restrictions and emotionally mixed experiences at living sacred heritage sites. Their GPT-4o extraction prompt uses a 12-type entity taxonomy, four relation types and nine aspect-sentiment dimensions; eight entity types are specific to sacred heritage. The authors apply it to a fixed random sample of 2,500 English-language Tripadvisor reviews from a processed corpus of 3,939.\n\nAgainst an adjudicated two-annotator reference for 200 reviews, exact normalized surface-and-type matching gave provisional entity micro-F1 of 28.4%. Aspect-presence F1 was 53.6%, and end-to-end aspect-plus-polarity F1 was 42.6%. Human adjudication supported 78.9% of first-listed relation candidates, one per review; the authors caution that this candidate-level rate does not estimate relation recall or whole-graph precision.\n\nThe paper presents a culturally grounded adaptation with component-wise human evaluation, while identifying reproducibility and generalization limitations. The reported scores are provisional and assess particular extraction components; they do not establish how well the approach generalizes beyond the study’s reviews.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The reported entity scores are provisional and use exact normalized surface-and-type matching against an adjudicated reference for 200 reviews. The source evaluates a fixed random sample of English-language Tripadvisor reviews about one temple; the excerpt does not report results for other languages or sites. The relation-candidate support rate does not estimate relation recall or whole-graph precision. The source names reproducibility and generalization limitations but the supplied abstract does not detail them.","speaker":{"name":"Pant, Pujan, Newpane, Sagar, Sitaula, Hari, Sakhakarmy, Manish","roleAtSource":"Article author"},"source":{"title":"Adapting LLM-SC to Living Sacred Heritage: Domain-Specific Extraction, Semantic Networks and Human Evaluation on Pashupatinath Temple Reviews","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2610.35685","publishedAt":"2026-10-26","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors argue that generic extraction schemes may miss features of living sacred heritage sites, and adapt LLM-SC for Pashupatinath Temple reviews.","excerpt":"generic schemes may miss rituals, sacred spaces, cultural restrictions and emotionally mixed experiences at living sacred heritage sites. We adapted the LLM-Social Computing (LLM-SC) framework to Pashupatinath Temple","url":"https://arxiv.org/abs/2610.35685","relationship":"Source-stated"},{"text":"The adaptation uses 12 entity types, four relation types and nine aspect-sentiment dimensions, including eight added sacred-heritage types.","excerpt":"a 12-type entity taxonomy (four original LLM-SC types plus eight sacred-heritage types), four relation types and nine aspect-sentiment dimensions","url":"https://arxiv.org/abs/2610.35685","relationship":"Source-stated"},{"text":"The authors applied the extraction prompt to a fixed random sample of 2,500 English-language Tripadvisor reviews from a processed corpus of 3,939.","excerpt":"applied to a fixed random sample of 2,500 English-language Tripadvisor reviews from a processed corpus of 3,939","url":"https://arxiv.org/abs/2610.35685","relationship":"Source-stated"},{"text":"Against an adjudicated two-annotator reference for 200 reviews, entity micro-F1 was 28.4%, aspect-presence F1 was 53.6%, and end-to-end aspect-plus-polarity F1 was 42.6%.","excerpt":"exact normalized surface-and-type matching gave provisional entity scores of 41.0% precision, 21.8% recall and 28.4% micro-F1. Aspect-presence F1 was 53.6% and end-to-end aspect-plus-polarity F1 was 42.6%.","url":"https://arxiv.org/abs/2610.35685","relationship":"Source-stated"},{"text":"Human adjudication supported 78.9% of first-listed relation candidates, but that candidate-level rate does not estimate relation recall or whole-graph precision.","excerpt":"Human adjudication supported 153 of 194 first-listed relation candidates (one per review; 78.9%), a candidate-level rate that does not estimate relation recall or whole-graph precision.","url":"https://arxiv.org/abs/2610.35685","relationship":"Source-stated"},{"text":"The authors describe the contribution as a culturally grounded adaptation with component-wise human evaluation and explicit reproducibility and generalization limitations.","excerpt":"The contribution is a culturally grounded, domain-specific adaptation with component-wise human evaluation and explicit reproducibility and generalization limitations.","url":"https://arxiv.org/abs/2610.35685","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.35685","checkedAt":"2026-11-11T00:40:09.369Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How would the reported component scores change when evaluated on reviews beyond the 200 used for the adjudicated reference?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Researchers adapt LLM-SC for Pashupatinath Temple reviews","summary":"Pujan Pant, Sagar Newpane, Hari Sitaula and Manish Sakhakarmy adapt the LLM-Social Computing (LLM-SC) framework to visitor reviews of Pashupatinath Temple in Nepal. They argue generic extraction schemes may miss rituals, sacred spaces, cultural restrictions and emotionally mixed experiences at living sacred heritage sites. Their GPT-4o extraction prompt uses a 12-type entity taxonomy, four relation types and nine aspect-sentiment dimensions; eight entity types are specific to sacred heritage. The authors apply it to a fixed random sample of 2,500 English-language Tripadvisor reviews from a processed corpus of 3,939.\n\nAgainst an adjudicated two-annotator reference for 200 reviews, exact normalized surface-and-type matching gave provisional entity micro-F1 of 28.4%. Aspect-presence F1 was 53.6%, and end-to-end aspect-plus-polarity F1 was 42.6%. Human adjudication supported 78.9% of first-listed relation candidates, one per review; the authors caution that this candidate-level rate does not estimate relation recall or whole-graph precision.\n\nThe paper presents a culturally grounded adaptation with component-wise human evaluation, while identifying reproducibility and generalization limitations. The reported scores are provisional and assess particular extraction components; they do not establish how well the approach generalizes beyond the study’s reviews.","question":"How would the reported component scores change when evaluated on reviews beyond the 200 used for the adjudicated reference?","claims":[{"text":"The authors argue that generic extraction schemes may miss features of living sacred heritage sites, and adapt LLM-SC for Pashupatinath Temple reviews.","excerpt":"generic schemes may miss rituals, sacred spaces, cultural restrictions and emotionally mixed experiences at living sacred heritage sites. We adapted the LLM-Social Computing (LLM-SC) framework to Pashupatinath Temple","support":"source-stated"},{"text":"The adaptation uses 12 entity types, four relation types and nine aspect-sentiment dimensions, including eight added sacred-heritage types.","excerpt":"a 12-type entity taxonomy (four original LLM-SC types plus eight sacred-heritage types), four relation types and nine aspect-sentiment dimensions","support":"source-stated"},{"text":"The authors applied the extraction prompt to a fixed random sample of 2,500 English-language Tripadvisor reviews from a processed corpus of 3,939.","excerpt":"applied to a fixed random sample of 2,500 English-language Tripadvisor reviews from a processed corpus of 3,939","support":"source-stated"},{"text":"Against an adjudicated two-annotator reference for 200 reviews, entity micro-F1 was 28.4%, aspect-presence F1 was 53.6%, and end-to-end aspect-plus-polarity F1 was 42.6%.","excerpt":"exact normalized surface-and-type matching gave provisional entity scores of 41.0% precision, 21.8% recall and 28.4% micro-F1. Aspect-presence F1 was 53.6% and end-to-end aspect-plus-polarity F1 was 42.6%.","support":"source-stated"},{"text":"Human adjudication supported 78.9% of first-listed relation candidates, but that candidate-level rate does not estimate relation recall or whole-graph precision.","excerpt":"Human adjudication supported 153 of 194 first-listed relation candidates (one per review; 78.9%), a candidate-level rate that does not estimate relation recall or whole-graph precision.","support":"source-stated"},{"text":"The authors describe the contribution as a culturally grounded adaptation with component-wise human evaluation and explicit reproducibility and generalization limitations.","excerpt":"The contribution is a culturally grounded, domain-specific adaptation with component-wise human evaluation and explicit reproducibility and generalization limitations.","support":"source-stated"}],"limitations":["The reported entity scores are provisional and use exact normalized surface-and-type matching against an adjudicated reference for 200 reviews.","The source evaluates a fixed random sample of English-language Tripadvisor reviews about one temple; the excerpt does not report results for other languages or sites.","The relation-candidate support rate does not estimate relation recall or whole-graph precision.","The source names reproducibility and generalization limitations but the supplied abstract does not detail them."],"mediaId":"8e3e66eca8532ad7c7d61b425624424c3cd58c126ff558aeee24d09f5697774a","correctionReason":null,"id":"4f5fd43b5d2e347d5df1dd8aa2d97ee3422974769ba0a9c46202fe1d98f1c2e4","publicationId":"79fc4b63-39d5-4410-8787-ea9f626d4082","version":1,"sourceUrl":"https://arxiv.org/abs/2610.35685","sourceTitle":"Adapting LLM-SC to Living Sacred Heritage: Domain-Specific Extraction, Semantic Networks and Human Evaluation on Pashupatinath Temple Reviews","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-10-26","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-02T05:04:51.375Z","createdAt":"2026-11-11T00:09:56.003Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"8e3e66eca8532ad7c7d61b425624424c3cd58c126ff558aeee24d09f5697774a","kind":"article","url":"https://arxiv.org/abs/2610.35685","sourceUrl":"https://arxiv.org/abs/2610.35685","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-03T04:45:43.422Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.35685","checkedAt":"2026-11-11T00:40:09.369Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"8e3e66eca8532ad7c7d61b425624424c3cd58c126ff558aeee24d09f5697774a","confidence":0.55,"provider":"typesafe","model":"jev-1.13.0","inputHash":"34efccbcb7b2288f7e468f50af45eed8883f9d570256832ab040fa6e34aaea83","decidedAt":"2026-11-03T04:45:44.175Z","redecided":{"from":"stream-admission-v5","under":"stream-admission-v5+confidence-0.5"}},"provenance":{"textHash":"d8aa99fcd4a598be1b270374a4766d36368f3fa34f30bb3b9bcaac01faab1b04","observationId":"cf117bdec45704e2716cdfc93f3b8ca487aa33c429837262b33901fbd356e37c","retrievedAt":"2026-11-03T04:45:43.324Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"6bc2f61f-09ea-4117-83d3-8d45736b328b"},"reviewer":{"model":"gpt-6-luna","runId":"e7e77203-bf45-4a67-8ec1-ce9f3a1dfacc"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-11T00:09:56.003Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Pant, Pujan","url":null,"kind":"unknown"},{"name":"Newpane, Sagar","url":null,"kind":"unknown"},{"name":"Sitaula, Hari","url":null,"kind":"unknown"},{"name":"Sakhakarmy, Manish","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Pant, Pujan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Pant, Pujan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.35685","locator":"head/meta[name=author|citation_author]"},"assertionId":"b7bdfa2a5cb2bb85bc9fffa16541ec0ca777fcf33d820c2a38e0c166f433f83e:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-11T00:40:09.369Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"b7bdfa2a5cb2bb85bc9fffa16541ec0ca777fcf33d820c2a38e0c166f433f83e","sourceUrl":"https://arxiv.org/abs/2610.35685","contentSha256":"8a192a51e85574776d70300478203ac42ff3f4b6b1c66952273f6bcc71daa45f","textHash":"d8aa99fcd4a598be1b270374a4766d36368f3fa34f30bb3b9bcaac01faab1b04","observedAt":"2026-11-11T00:40:09.369Z"}},{"actor":{"name":"Newpane, Sagar","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Newpane, Sagar","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.35685","locator":"head/meta[name=author|citation_author]"},"assertionId":"b7bdfa2a5cb2bb85bc9fffa16541ec0ca777fcf33d820c2a38e0c166f433f83e:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-11T00:40:09.369Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"b7bdfa2a5cb2bb85bc9fffa16541ec0ca777fcf33d820c2a38e0c166f433f83e","sourceUrl":"https://arxiv.org/abs/2610.35685","contentSha256":"8a192a51e85574776d70300478203ac42ff3f4b6b1c66952273f6bcc71daa45f","textHash":"d8aa99fcd4a598be1b270374a4766d36368f3fa34f30bb3b9bcaac01faab1b04","observedAt":"2026-11-11T00:40:09.369Z"}},{"actor":{"name":"Sitaula, Hari","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Sitaula, Hari","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.35685","locator":"head/meta[name=author|citation_author]"},"assertionId":"b7bdfa2a5cb2bb85bc9fffa16541ec0ca777fcf33d820c2a38e0c166f433f83e:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-11T00:40:09.369Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"b7bdfa2a5cb2bb85bc9fffa16541ec0ca777fcf33d820c2a38e0c166f433f83e","sourceUrl":"https://arxiv.org/abs/2610.35685","contentSha256":"8a192a51e85574776d70300478203ac42ff3f4b6b1c66952273f6bcc71daa45f","textHash":"d8aa99fcd4a598be1b270374a4766d36368f3fa34f30bb3b9bcaac01faab1b04","observedAt":"2026-11-11T00:40:09.369Z"}},{"actor":{"name":"Sakhakarmy, Manish","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Sakhakarmy, Manish","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.35685","locator":"head/meta[name=author|citation_author]"},"assertionId":"b7bdfa2a5cb2bb85bc9fffa16541ec0ca777fcf33d820c2a38e0c166f433f83e:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-11T00:40:09.369Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"b7bdfa2a5cb2bb85bc9fffa16541ec0ca777fcf33d820c2a38e0c166f433f83e","sourceUrl":"https://arxiv.org/abs/2610.35685","contentSha256":"8a192a51e85574776d70300478203ac42ff3f4b6b1c66952273f6bcc71daa45f","textHash":"d8aa99fcd4a598be1b270374a4766d36368f3fa34f30bb3b9bcaac01faab1b04","observedAt":"2026-11-11T00:40:09.369Z"}}],"participationCoverage":{"total":4,"returned":4,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2610.35685","snapshotId":"b7bdfa2a5cb2bb85bc9fffa16541ec0ca777fcf33d820c2a38e0c166f433f83e","contentSha256":"8a192a51e85574776d70300478203ac42ff3f4b6b1c66952273f6bcc71daa45f","textHash":"d8aa99fcd4a598be1b270374a4766d36368f3fa34f30bb3b9bcaac01faab1b04","observedAt":"2026-11-11T00:40:09.369Z","basis":"publisher-page-metadata","sourceLinks":42,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/4f5fd43b5d2e347d5df1dd8aa2d97ee3422974769ba0a9c46202fe1d98f1c2e4/source"}}}],"audits":[{"publicationId":"79fc4b63-39d5-4410-8787-ea9f626d4082","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The draft correctly names the four authors (Pant, Newpane, Sitaula, Sakhakarmy) and keeps the argument and results attributed to them. The 'arXiv cs.AI' label matches the feed. The paper's primary listing is cs.CL, cross-listed to cs.AI.","excerpt":"Authors:Pujan Pant, Sagar Newpane, Hari Sitaula, Manish Sakhakarmy"},{"dimension":"summary","status":"uncertain","explanation":"The draft never says what the pipeline is for. The abstract's core premise is that LLM pipelines turn visitor reviews into structured data. Without that, a non-specialist cannot tell what 'extraction', 'entity taxonomy' or 'aspect-sentiment dimensions' produce, or why missing rituals matters. Central metrics are also unglossed: micro-F1, precision, recall and exact surface-and-type matching. Entity recall (21.8%) is omitted, though it shows most reference entities were missed. Smallest repair: open with that structured-data sentence, add term tooltips for F1, precision and recall, and keep the precision and recall figures. The question is reasonable.","excerpt":"Large language model (LLM) pipelines can turn visitor reviews into structured data"},{"dimension":"date","status":"pass","explanation":"The originalPublished date of 2026-10-26 matches the v1 submission date. It is not the 30 Oct v2 revision or the 2 Nov feed date.","excerpt":"Submitted on 26 Oct 2026 (v1), last revised 30 Oct 2026 (this version, v2)"},{"dimension":"support","status":"uncertain","explanation":"The claims and figures match the abstract. However, the closing sentence says 'The reported scores are provisional,' and the source labels only the entity scores as provisional. The aspect F1 scores and the relation rate are not described that way. Smallest repair: 'The entity scores are provisional...'. The point that the results do not establish generalization is a fair reading of the stated limitations.","excerpt":"exact normalized surface-and-type matching gave provisional entity scores of 41.0% precision, 21.8% recall and 28.4% micro-F1"},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct link to the arXiv abstract page of this paper, which is the most direct access to the source.","excerpt":null}],"createdAt":"2026-11-11T00:09:56.003Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}