On July 20, 1969, astronaut Neil Armstrong walked on the moon. He was leading the NASA’s Apollo 11 mission. Armstrong famously said, “That’s one small step for man, one giant leap for mankind” as he stepped onto the lunar surface.
On July 20, 1969, astronaut Neil Armstrong walked on the moon. Neil Armstrong was leading the NASA’s Apollo 11 mission. Neil Armstrong famously said, “That’s one small step for man, one giant leap for mankind” as he stepped onto the lunar surface.
sentences = extraction_chain.invoke( """ On July 20, 1969, astronaut Neil Armstrong walked on the moon. He was leading the NASA's Apollo 11 mission. Armstrong famously said, "That's one small step for man, one giant leap for mankind" as he stepped onto the lunar surface. """ )
def find_chunk_and_push_proposition(proposition): class ChunkID(BaseModel): chunk_id: int = Field(description="The chunk id.") allocation_llm = llm.with_structured_output(ChunkID) allocation_prompt = ChatPromptTemplate.from_messages([ ("system", "Find the chunk that best matches the proposition. If no chunk matches, return a new chunk id."), ("user", "proposition:{proposition} chunks_summaries:{chunks_summaries}"), ]) allocation_chain = allocation_prompt | allocation_llm chunks_summaries = {chunk_id: chunk["summary"] for chunk_id, chunk in chunks.items()} best_chunk_id = allocation_chain.invoke({"proposition": proposition, "chunks_summaries": chunks_summaries}).chunk_id if best_chunk_id not in chunks: create_new_chunk(best_chunk_id, proposition) else: add_proposition(best_chunk_id, proposition)
实测效果如何
我选择了新加坡圣淘沙著名景点 Wings of Time 的介绍文本作为测试对象，使用 GPT-4 模型进行处理。这段文本包含了景点介绍、票务信息、开放时间等多个方面的内容，是一个很好的测试样本。
Product Name: Wings of Time
Product Description: Wings of Time is one of Sentosa's most breathtaking attractions, combining water, laser, fire, and music to create a mesmerizing night show about friendship and courage. Situated on the scenic (https://www.sentosa.com.sg/en/things-to-do/attractions/siloso-beach/) Siloso Beach , this award-winning spectacle is staged nightly, promising an unforgettable experience for visitors of all ages. Be wowed by spellbinding laser, fire, and water effects set to a majestic soundtrack, complete with a jaw-dropping fireworks display. A fitting end to your day out at Sentosa, it’s possibly the only place in Singapore where you can witness such an awe-inspiring performance. Get ready for an even better experience starting 1 February 2025 ! Wings of Time Fireworks Symphony, Singapore’s only daily fireworks show, now features a fireworks display that is four times longer! Important Note: Please visit (https://www.sentosa.com.sg/sentosa-reservation) here if you need to change your visit date. All changes must be made at least 1 day prior to the visit date.
Product Category: Shows
Product Type: Attraction
Keywords: Wings of Time, Sentosa night show, Sentosa attractions, laser show Sentosa, water show Singapore, Sentosa events, family activities Sentosa, Singapore night shows, outdoor night show Sentosa, book Wings of Time tickets
Meta Description: Experience Wings of Time at Sentosa! A breathtaking night show featuring water, laser, and fire effects. Perfect for a memorable evening.
Product Tags: Family Fun,Popular experiences,Frequently Bought
Locations: Beach Station
[Tickets]
Name: Wings of Time (Std) Terms: • All Wings of Time (WOT) Open-Dated tickets require prior redemption at Singapore Cable Car Ticketing counters and are subjected to seats availability on a first come first serve basis. • This is a rain or shine event. Tickets are non-exchangeable or nonrefundable under any circumstances. • Once timeslot is confirmed, no further amendments are allowed. Please proceed to WOT admission gates to scan your issued QR code via mobile or physical printout for admission. • Gates will open 15 minutes prior to the start of the show. • Show Duration: 20 minutes per show. • Please be punctual for your booked time slot. • Admission will be on a first come first serve basis within the allocated timeslot or at the discretion of the attraction host. • Standard seats are applicable to guest aged 4 years and above. • No outside Food & Drinks are allowed. • Refer to (https://www.mountfaberleisure.com/attraction/wings-of-time/) https://www.mountfaberleisure.com/attraction/wings-of-time/ for more information on Wings of Time. Pax Type: Standard Promotion A: Enjoy $1.90 off when you purchase online! Discount will automatically be applied upon checkout. Price: 19
Opening Hours: Daily Show 1: 7.40pm Show 2: 8.40pm
Accessibilities: Wheelchair
[Information]
Title: Terms & Conditions Description: For more information, click (https://www.sentosa.com.sg/en/promotional-general-store-terms-and-conditions) here for Terms & Conditions
Title: Getting Here Description: By Sentosa Express: Alight at Beach Station By Public Bus: Board Bus 123 and alight at Beach Station By Intra-Island Bus: Board Sentosa Bus A or B and alight at Beach Station Nearest Car Park Beach Station Car Park
Title: Contact Us Description: Beach Station +65 6361 0088 (mailto:guestrelations@mflg.com.sg) guestrelations@mflg.com.sg
系统首先将原文转化为 50 多个独立的陈述句（propositions）。有趣的是，在这个过程中，系统自动将每句话的主语统一为"Wings of Time"，这显示出了 AI 对文本主题的准确把握。
[ "Wings of Time is one of Sentosa's most breathtaking attractions.", 'Wings of Time combines water, laser, fire, and music to create a mesmerizing night show.', 'The night show of Wings of Time is about friendship and courage.', 'Wings of Time is situated on the scenic Siloso Beach.', 'Wings of Time is an award-winning spectacle staged nightly.', 'Wings of Time promises an unforgettable experience for visitors of all ages.', 'Wings of Time features spellbinding laser, fire, and water effects set to a majestic soundtrack.', 'Wings of Time includes a jaw-dropping fireworks display.', 'Wings of Time is a fitting end to a day out at Sentosa.', 'Wings of Time is possibly the only place in Singapore where such an awe-inspiring performance can be witnessed.', 'Wings of Time will offer an even better experience starting 1 February 2025.', 'Wings of Time Fireworks Symphony is Singapore’s only daily fireworks show.', 'Wings of Time Fireworks Symphony now features a fireworks display that is four times longer.', 'Visitors should visit the provided link if they need to change their visit date to Wings of Time.', 'All changes to the visit date must be made at least 1 day prior to the visit date.', 'Wings of Time is categorized as a show.', 'Wings of Time is a type of attraction.', 'Keywords for Wings of Time include: Wings of Time, Sentosa night show, Sentosa attractions, laser show Sentosa, water show Singapore, Sentosa events, family activities Sentosa, Singapore night shows, outdoor night show Sentosa, book Wings of Time tickets.', 'The meta description for Wings of Time is: Experience Wings of Time at Sentosa! A breathtaking night show featuring water, laser, and fire effects. Perfect for a memorable evening.', 'roduct tags for Wings of Time include: Family Fun, Popular experiences, Frequently Bought.', 'Wings of Time is located at Beach Station.', 'Wings of Time (Std) tickets require prior redemption at Singapore Cable Car Ticketing counters.', 'Wings of Time (Std) tickets are subjected to seats availability on a first come first serve basis.', 'Wings of Time is a rain or shine event.', 'Tickets for Wings of Time are non-exchangeable or nonrefundable under any circumstances.', 'Once the timeslot for Wings of Time is confirmed, no further amendments are allowed.', 'Visitors should proceed to Wings of Time admission gates to scan their issued QR code via mobile or physical printout for admission.', 'Gates for Wings of Time will open 15 minutes prior to the start of the show.', 'The show duration for Wings of Time is 20 minutes per show.', 'Visitors should be punctual for their booked time slot for Wings of Time.', 'Admission to Wings of Time will be on a first come first serve basis within the allocated timeslot or at the discretion of the attraction host.', 'Standard seats for Wings of Time are applicable to guests aged 4 years and above.', 'No outside food and drinks are allowed at Wings of Time.', 'More information on Wings of Time can be found at the provided link.', 'The pax type for Wings of Time is Standard.', 'romotion A for Wings of Time offers $1.90 off when purchased online.', 'The discount for Promotion A will automatically be applied upon checkout.', 'The price for Wings of Time is 19.', 'Wings of Time has opening hours daily with Show 1 at 7.40pm and Show 2 at 8.40pm.', 'Wings of Time is accessible by wheelchair.', "The title for terms and conditions is 'Terms & Conditions'.", 'More information on terms and conditions can be found at the provided link.', "The title for getting to Wings of Time is 'Getting Here'.", 'Visitors can get to Wings of Time by Sentosa Express by alighting at Beach Station.', 'Visitors can get to Wings of Time by Public Bus by boarding Bus 123 and alighting at Beach Station.', 'Visitors can get to Wings of Time by Intra-Island Bus by boarding Sentosa Bus A or B and alighting at Beach Station.', 'The nearest car park to Wings of Time is Beach Station Car Park.', "The title for contacting Wings of Time is 'Contact Us'.", 'The contact location for Wings of Time is Beach Station.', 'The contact phone number for Wings of Time is +65 6361 0088.', 'The contact email for Wings of Time is guestrelations@mflg.com.sg.']
经过 AI 的智能分块（agentic chunking），整个文本被自然地划分为四个主要部分：
主体信息块：包含了 Wings of Time 的核心介绍、特色、位置等综合信息
日程政策块：专门处理预约变更相关的信息
价格优惠块：聚焦于折扣和支付相关内容
法律条款块：归纳了各项条款和规定
Chunk (a641f): Sentosa's Wings of Time Show & Visitor Information Summary: This chunk contains comprehensive details about the Wings of Time attraction in Sentosa, including its features, themes, location, visitor experience, ticketing and admission procedures, future enhancements, promotions, classification as a show and attraction, unique fireworks display, daily show schedule, accessibility options, importance of punctuality and ticket redemption, extended fireworks display in the Fireworks Symphony, transportation options to reach the venue, and the necessity of adhering to non-exchangeable ticket policies, with a focus on the standard ticketing process and visitor guidelines, and the recent update on the extended fireworks display, as well as the contact information and accessibility details, and the new experience starting February 2025.
Chunk (ae2b8): Scheduling Policies Summary: This chunk contains information about policies regarding changes to scheduled dates and times.
Chunk (dadbb): Retail & Discounts Summary: This chunk contains information about the application of discounts during the checkout process.
Chunk (3347c): Legal Terms & Conditions Summary: This chunk contains information about terms and conditions, including their titles and where to find more information.
roduct tags for Wings of Time include: Family Fun, Popular experiences, Frequently Bought.',