metadata
language:
- en
tags:
- sentence-transformers
- sentence-similarity
- feature-extraction
- generated_from_trainer
- dataset_size:104601
- loss:MultipleNegativesRankingLoss
base_model: nomic-ai/modernbert-embed-base
widget:
- source_sentence: >-
How can the company assess the financial viability of its gaming division
in relation to its overall business strategy?
sentences:
- >-
In the event of a partial or total liquidation of the Partnership or in
the event there were insufficient Partnership assets to satisfy the
claims of its general creditors , the limited partners may not be
entitled to receive their entire Capital Contribut ion amounts back.
Limited partner capital ac counts are not guaranteed. However, as a
class, the limit ed partners would be entitled to receive the return of
their aggregate Capital Contri butions before the return of any capital
contributions to the subordinated limited partners or the general
partners. If the Partnership experiences losses in any year but
liquidation procedures described above are not undertaken and the Partne
rship continues, the amounts of such losses would be absorbed in the
capital accounts of the partners as described in the Partnership
Agreement, and each limited partner in any event remains entitled to
receive the 7½% Payments under t he terms of the Partnership Agreement.
However, as there would be no accumulated profits in such a year,
limited partner s would not receive any sums representing participation
in net income of the Partnership. In addition, although the amount of
the 7½% Payments to limited partners are charged as an expense to the
Partnership and are pay able whether or not the Partnership ear ns any
accumulated profits during any given period, no reserve fund has been
set aside to enable the Partnership to make such payments. Therefore,
such payments to the limited partners are subject to the Partnership’s
ability to service the 7½% Payment, of which there is no assurance.
- >-
10. Compliance of Award Agreement and Plan with Section 409A . The
provisions of this Paragraph 10 apply to you only if you are a U.S.
taxpayer. (a) This Award Agreement and the Plan provisions that apply to
this Award are intended and will be construed to comply with Section
409A (including the requirements applicable to, or the conditions for
exemption from treatment as, 409A Deferred Compensation), whether by
reason of short-term deferral treatment or other exceptions or
provisions. The Committee will have full authority to give effect to
this intent. To the extent necessary to give effect to this intent, in
the case of any conflict or potential inconsistency between the
provisions of the Plan (including Sections 1.3.2 and 2.1 thereof) and
this Award Agreement, the provisions of this Award Agreement will
govern, and in the case of any conflict or potential inconsistency
between this Paragraph 10 and the other provisions of this Award
Agreement, this Paragraph 10 will govern. (b) Delivery of RSU Shares
will not be delayed beyond the date on which all applicable conditions
or restrictions on delivery of RSU Shares required by this Agreement
(including those specified in Paragraphs 4, 6(b) and 7 and the consents
and other items specified in Section 3.3 of the Plan) are satisfied, and
will occur by December 31 of the calendar year in which the Delivery
Date occurs unless, in order to permit such conditions or restrictions
to be satisfied, the Committee elects, pursuant to Reg.
1.409A-1(b)(4)(i)(D) or otherwise as may be permitted in accordance with
Section 409A, to delay delivery of RSU Shares to a later date as may be
permitted under Section 409A, including Reg. 1.409A-3(d). For the
avoidance of doubt, if the Award includes a “series of installment
payments” as described in Reg. 1.409A-2(b)(2)(iii), your right to the
series of installment payments will be treated as a right to a series of
separate payments and not as a right to a single payment. (c)
Notwithstanding the provisions of Paragraph 7(b) and Section 1.3.2(i) of
the Plan, to the extent necessary to comply with Section 409A, any
securities, other Awards or other property that the Firm may deliver in
respect of your RSUs will not have the effect of deferring delivery or
payment, income inclusion, or a substantial risk of forfeiture, beyond
the date on which such delivery, payment or inclusion would occur or
such risk of forfeiture would lapse, with respect to the RSU Shares that
would otherwise have been deliverable (unless the Committee elects a
later date for this purpose pursuant to Reg. 1.409A-1(b)(4)(i)(D) or
otherwise as may be permitted under Section 409A, including and to the
extent applicable, the subsequent election provisions of Section
409A(a)(4)(C) of the Code and Reg. 1.409A-2(b)). (d) Notwithstanding the
timing provisions of Paragraph 6(b), the delivery of RSU Shares referred
to therein will be made after the date of death and during the calendar
year that includes the date of death (or on such later date as may be
permitted under Section 409A). (e) Notwithstanding any provision of
Paragraph 5 or Section 2.8.2 of the Plan to the contrary, the Dividend
Equivalent Rights with respect to each of your Outstanding RSUs will be
paid to you within the calendar year that includes the date of
distribution of any corresponding regular cash dividends paid by GS Inc.
in respect of a share of Common Stock the record date for which occurs
on or after the Date of Grant. The payment will be in an amount (less
applicable withholding) equal to such regular dividend payment as would
have been made in respect of the RSU Shares underlying such Outstanding
RSUs. (f) The timing of delivery or payment referred to in Paragraph
6(a)(i) will be the earlier of (i) the Delivery Date or (ii) within the
calendar year in which the Committee receives satisfactory documentation
relating to your Conflicted Employment, provided that such delivery or
payment will be made, and any Committee action referred to in Paragraph
6(a)(i) will be taken, only at such time as, and if and to the extent
that it, as reasonably determined by the Firm, would not result in the
imposition of any additional tax to you under Section 409A.
- >-
PART I Item 1 15 OPERATIONS We have regional operations service centers
that support our operations, including customer contract and order
processing, billing, credit and collections, information processing, and
vendor management and logistics. The center in Ireland supports the
African, Asia -Pacific, European, and Middle East regions ; and the
centers in Arlington, Virginia, Atlanta, Georgia , Charlotte, North
Carolina, Fargo, North Dakota, Fort Lauderdale, Florida, Redmond,
Washington, Reno, Nevada , and Puerto Rico support the America n region
s. In addition to our operations centers, we also operate datacenters
throughout each of these regions . We continue to identify and evaluate
opportunities to expand our datacenter locations and increase our server
capacity to me et the evolving needs of our customers, particularly
given the growing demand for AI services . Our datacenters depend on the
availability of permitted and buildable land, predictable energy,
networking supplies, and servers, including graphics processing units (“
GPUs ”) and other components. Our devices are primarily manufactured by
third -party contract manufacturers. For the majority of our products,
we have the ability to use other manufacturers if a current vendor
becomes unavailable or unable to meet our requirements. However, some of
our products contain certain components for which there are very few
qualified suppliers. Extended disruptions at these suppliers could
impact our ability to manufacture devices on time to meet consumer
demand. RESEARCH AND DEVELOPMENT Product and Service Development, and
Intellectual Property We develop most of our products and services
internally through the following engineering groups. • Cloud and AI –
focuses on making IT professionals, developers, partners, independent
software vendors, and their systems more productive and efficient
through development of Azure AI platform and cloud infrastructure,
server, database, CRM, ERP, software development tools and services
(including GitHub), AI cognitive services, and other business process
applications and services for enterprises. • Strategic Missions and
Technologies – focuses on incubating technical products and support
solutions with transformative potential for the future of cloud
computing and continued company growth across quantum computing, Azure
Space & Missions Engineering, telecommunications, and Microsoft F ederal
Sales and Delivery. • Experiences and Devices – focuses on delivering
high value end -user experiences across our products, services, and
devices, including Microsoft 365, Windows, Microsoft Teams, Search
(including Microsoft Edge and Bing Chat) and other advertising -based
services, and the Surface line of devices. • Microsoft Security –
focuses on delivering a comprehensive portfolio of services that protect
our customers’ digital infrastructure through cloud platform and
application security, data protection and governance, identity and
network access, and device management . • Technology and Research –
focuses on fundamental research, product and business incubations , and
forward -looking AI innovations that span infrastructure, services, and
applications. • LinkedIn – focuses on our services that transform the
way professionals grow their network and find jobs and the way
businesses hire, market, sell, and learn. • Gaming – focuses on
developing hardware, content, and services across a large range of
platforms to help grow our user base through game experiences and social
interaction. Internal development allows us to maintain competitive
advantages that come from product differentiation and closer technical
control over our products and services. It also gives us the freedom to
decide which modifications and enhancements are most impor tant and when
they should be implemented. We strive to obtain information as early as
possible about changing usage patterns and hardware advances that may
affect software and hardware design. Before releasing new software
platforms, and as we make signifi cant modifications to existing
platforms, we provide application vendors with a range of resources and
guidelines for development, training, and testing. Generally, we also
create product documentation internally. We protect our intellectual
property investments in a variety of ways. We work actively in the U.S.
and internationally to ensure the enforcement of copyright, trademark,
trade secret, and other protections that apply to our software and
hardware products, services, business plans, and branding. We are a
leader among technology companies in pursuing patents and currently have
a portfolio of over 70,000 U.S. and international patents issued and
over 19,000 pending
- source_sentence: >-
Why is it essential for financial institutions to regularly recalibrate
their model parameters?
sentences:
- >-
Balances at the beginning of the year reflect the segment structure as
of December 31, 2023. 1 Non-core and Legacy (including Investment Bank).
2 Adjustments represent certain consolidating entries, including those
relating to entities that are managed but are not owned or wholly owned
by Credit Suisse. 3 Represents changes in portfolio size. 4 Represents
movements arising from internally driven updates to models and
recalibrations of model parameters specific only to Credit Suisse. 5
Represents movements arising from externally driven updates to models
and recalibrations of model parameters specific only to Credit Suisse.
- >-
Resolving potential conflicts necessarily depends on the facts and
circumstances of a particular situation and the application of
experienced and informed judgment. As a general matter, Conflicts
Resolution reviews financing and advisory assignments in Global Banking
& Markets and certain of our investing, lending and other activities. In
addition, we have various transaction oversight committees, such as the
Firmwide Capital, Commitments and Suitability Committees and other
committees that also review new underwritings, loans, investments and
structured products. These groups and committees work with internal and
external counsel and Compliance to evaluate and address any actual or
potential conflicts. The head of Conflicts Resolution reports to our
chief legal officer, who reports to our chief executive officer. We
regularly assess our policies and procedures that address conflicts of
interest in an effort to conduct our business in accordance with the
highest ethical standards and in compliance with all applicable laws,
rules and regulations. For further information about our risk management
processes, see “Overview and Structure of Risk Management” and “Risk
Factors” in Part I, Item 1A of this Form 10-K.THE GOLDMAN SACHS GROUP,
INC. AND SUBSIDIARIES Management’s Discussion and Analysis Goldman Sachs
2023 Form 10-K 123
- >-
PART IV 85 ITEM 15. EXHIBITS AND FINANCIAL STATEMENT SCHEDULES INDEX
Page No. (a)(1) The followin g financial statements are included in Part
II, Item 8: Mana gement’s Report on Internal Control over Financial
Reportin g 45 Report of Independent Re gistered Public Accountin g Firm
46 Consolidated Statements of Financial Condition as of December 31,
2023 and 2022 48 Consolidated Statements of Income for the years ended
December 31, 2023, 2022 and 2021 49 Consolidated Statements of Changes
in Partnership Capital Subject to Mandatory Redemption for the years
ended December 31, 2023, 2022 and 2021 50 Consolidated Statements of
Cash Flows for the years ended December 31, 2023, 2022 and 2021 51 Notes
to Consolidated Financial Statements 52 (2) The followin g financial
statements are included in Schedule I: Parent Compan y Only Condensed
Statements of Financial Condition as of December 31, 2023 and 2022 90
Parent Company Only Condensed Statements of Income for the years ended
December 31, 2023, 2022 and 2021 91 Parent Company Only Condensed
Statements of Cash Flows for the years ended December 31, 2023, 2022 and
2021 92 Other schedules are omitted because they are not required,
inapplicable, or the information is otherwise shown in the Consolidated
Financial Statements or notes thereto. (b) Exhibits Reference is made to
the Exhibit Index hereinafter contained.
- source_sentence: >-
**Comparative Analysis**: Compare the share volumes of GlaxoSmithKline
Pharmaceuticals Ltd. and Hindustan Zinc Ltd. and discuss what this might
suggest about investor interest in these companies.
sentences:
- >-
Institutional active AUM ended 2023 at $1.9 trillion, reflecting $87
billion of net inflows, driven by the funding of several significant
outsourcing mandates and continued growth in our LifePath® target-date
and private markets platforms. Multi-asset net inflows of $86 billion
reflected continued growth from significant pension outsourcing mandates
and LifePath target-date offerings. Fixed income net inflows of $5
billion similarly reflected the funding of insurance outsourcing
mandates. Equity net outflows of $13 billion were primarily from
quantitative equity strategies. Alternatives net inflows of $10 billion
were led by infrastructure, private credit and private equity. Excluding
return of capital and investment of $7 billion, alternatives net inflows
were $17 billion. At year-end, BlackRock had approximately $32 billion
of non-fee paying, unfunded, uninvested commitments to deploy for
institutional clients, which is not included in AUM. Institutional
active represented 21% of long-term AUM and 19% of long-term base fees
and securities lending revenue for 2023. Institutional index AUM totaled
$2.9 trillion at December 31, 2023, reflecting $55 billion of net
outflows, driven by equities. Institutional index represented 31% of
long-term AUM and 7% of long-term base fees and securities lending
revenue for 2023. The Company’s institutional clients consist of the
following: •Pensions, Foundations and Endowments BlackRock is among the
world’s largest managers of pension plan assets with $3.0 trillion, or
63%, of long-term institutional AUM managed for defined benefit, defined
contribution and other pension plans for corporations, governments and
unions at December 31, 2023. The market landscape continues to shift
from defined benefit to defined contribution, and our defined
contribution channel represented $1.5 trillion of total pension AUM.
BlackRock remains well positioned for the on-going evolution of the
defined contribution market and demand for outcome-oriented investments.
An additional $83 billion, or 2%, of long-term institutional AUM was
managed for other tax-exempt investors, including charities, foundations
and endowments. •Official Institutions BlackRock managed $272 billion,
or 6%, of long-term institutional AUM for official institutions,
including central banks, sovereign wealth funds, supranationals,
multilateral entities and government ministries and agencies at year-end
2023. These clients often require specialized investment advice, the use
of customized benchmarks and training support. •Financial and Other
Institutions BlackRock is a top independent manager of assets for
insurance companies, which accounted for $650 billion, or 13%, of
long-term institutional AUM at year-end 2023. Assets managed for other
taxable institutions, including corporations, banks and third-party fund
sponsors for which the Company provides sub-advisory services, totaled
$773 billion, or 16%, of long-term institutional AUM at year-end. 5
- >-
Fair Value Option At December 31, 2023 and 2022, the Company elected the
fair value option for certain investments in CLOs of approximately $42
million and $52 million, respectively, reported within investments. In
addition, the Company elected the fair value option for bank loans and
borrowings of a consolidated CLO, recorded within investments and other
liabilities, respectively. The following table summarizes the
information related to these bank loans and borrowings at December 31,
2023 and 2022: December 31, December 31, (in millions) 2023 2022 CLO
Bank loans: Aggregate principal amounts outstanding $ 203 $ 238 Fair
value 194 234 Aggregate unpaid principal balance in excess of (less
than) fair value $ 9 $ 4 CLO Borrowings: Aggregate principal amounts
outstanding $ 190 $ 245 Fair value $ 180 $ 245 At December 31, 2023, the
principal amounts outstanding of the borrowings issued by the CLOs
mature in 2030 and may be repaid prior to maturity at any time. During
the year ended December 31, 2023 and 2022, the net gains (losses) from
the change in fair value of the bank loans and borrowings held by the
consolidated CLO were not material and were recorded in net gain (loss)
on the consolidated statements of income. The change in fair value of
the assets and liabilities included interest income and expense,
respectively. 8. Derivatives and Hedging The Company maintains a program
to enter into exchange traded futures as a macro hedging strategy to
hedge market price and interest rate exposures with respect to its total
portfolio of seed investments in sponsored investment products. At
December 31, 2023 and 2022, the Company had outstanding exchange traded
futures related to this macro hedging strategy with aggregate notional
values of approximately $1.8 billion and $1.5 billion, with expiration
dates during the first quarter of 2024 and 2023, respectively. In
addition, beginning in the first quarter of 2023, the Company entered
into futures to economically hedge the exposure to market movements on
certain deferred cash compensation plans. At December 31, 2023 , the
Company had outstanding exchange traded futures with aggregate notional
values related to its deferred cash compensation hedging program of
approximately $204 million, with expiration dates during the first
quarter of 2024. Changes in the value of the futures contracts are
recognized as gains or losses within nonoperating income (expense).
Variation margin payments, which represent settlements of profit/loss,
are generally received or made daily, and are reflected in other assets
and other liabilities on the consolidated statements of financial
condition. These amounts were not material as of December 31, 2023 and
2022. The Company executes forward foreign currency exchange contracts
to mitigate the risk of certain foreign exchange movements. At December
31, 2023 and 2022, the Company had outstanding forward foreign currency
exchange contracts with aggregate notional values of approximately $3.1
billion and $2.2 billion, with expiration dates in January 2024 and
January 2023, respectively. At both December 31, 2023 and 2022, the
Company had a derivative providing credit protection with a notional
amount of approximately $17 million to a counterparty, representing the
Company’s maximum risk of loss with respect to the derivative. The
Company carries the derivative at fair value based on the expected
discounted future cash outflows under the arrangement.
- >-
67 1,845 0.00% Punjab National Bank 2,894 1,822 0.00% Bayer CropScience
Ltd. 33 1,762 0.00% Central Depository Services India Ltd. 122 1,652
0.00% Balrampur Chini Mills Ltd. 352 1,650 0.00% Kansai Nerolac Paints
Ltd. 299 1,642 0.00% Finolex Cables Ltd. 150 1,570 0.00% Jubilant
Ingrevia Ltd. 298 1,549 0.00% EID Parry India Ltd. 272 1,533 0.00% Suven
Pharmaceuticals Ltd. 252 1,492 0.00% Indian Energy Exchange Ltd. 957
1,483 0.00% PNB Housing Finance Ltd. 205 1,418 0.00% ICICI Securities
Ltd. 188 1,394 0.00% GlaxoSmithKline Pharmaceuticals Ltd. 78 1,355 0.00%
DCM Shriram Ltd. 121 1,332 0.00% Aditya Birla Capital Ltd. 536 1,283
0.00% Relaxo Footwears Ltd. 114 1,263 0.00% Birlasoft Ltd. 288 1,260
0.00% Intellect Design Arena Ltd. 159 1,218 0.00% Amber Enterprises
India Ltd. 44 1,210 0.00% Indiabulls Housing Finance Ltd. 735 1,106
0.00% Ajanta Pharma Ltd. 61 1,100 0.00% NCC Ltd. 701 1,043 0.00% V-Guard
Industries Ltd. 281 968 0.00% Infibeam Avenues Ltd. 4,918 944 0.00%
Orient Electric Ltd. 303 884 0.00% Alok Industries Ltd. 4,187 834 0.00%
Edelweiss Financial Services Ltd. 1,357 824 0.00% Hindustan Zinc Ltd.
211 790 0.00% Natco Pharma Ltd. 92 777 0.00% Chambal Fertilisers &
Chemicals Ltd. 219 728 0.00% General Insurance Corp. of India 311 692
0.00% Firstsource Solutions Ltd. 439 681 0.00% Granules India Ltd. 169
612 0.00% Metropolis Healthcare Ltd. 33 601 0.00% Whirlpool of India
Ltd. 31 557 0.00% Nuvama Wealth Management Ltd. 15 518 0.00% Quess
Corp., Ltd. 87 477 0.00% Graphite India Ltd. 95 463 0.00% IndiaMart
InterMesh Ltd. 12 412 0.00% Strides Pharma Science Ltd. 76 399 0.00%
- source_sentence: >-
**Investment Strategies**: What investment strategies might be appropriate
for a portfolio that includes companies like Paycom Software, Inc. and
Jabil, Inc.?
sentences:
- >-
Nacional del Cobre de Chile $200,000 3.75% 15/1/2031 181,259 0.01% Corp.
Nacional del Cobre de Chile $200,000 4.88% 4/11/2044 180,292 0.01%
Falabella SA $200,000 3.75% 30/10/2027 179,533 0.01% Inversiones CMPC SA
$200,000 3.85% 13/1/2030 178,796 0.01% Chile Government International
Bond $200,000 4.34% 7/3/2042 177,818 0.01% Corp. Nacional del Cobre de
Chile $200,000 3.15% 14/1/2030 177,141 0.01% Chile Government
International Bond €200,000 0.83% 2/7/2031 171,492 0.00% Engie Energia
Chile SA $200,000 3.40% 28/1/2030 166,435 0.00% Empresa de Transporte de
Pasajeros Metro SA $200,000 4.70% 7/5/2050 166,104 0.00% Chile
Government International Bond $200,000 2.55% 27/7/2033 163,560 0.00%
Chile Government International Bond $200,000 4.00% 31/1/2052 163,452
0.00% Corp. Nacional del Cobre de Chile $200,000 3.70% 30/1/2050 150,948
0.00% GNL Quintero SA $152,960 4.63% 31/7/2029 148,833 0.00% Alfa
Desarrollo SpA $199,014 4.55% 27/9/2051 146,111 0.00% Banco Santander
Chile $150,000 2.70% 10/1/2025 143,340 0.00% Corp. Nacional del Cobre de
Chile $200,000 3.15% 15/1/2051 140,129 0.00% Chile Government
International Bond €150,000 0.56% 21/1/2029 136,242 0.00% Bonos de la
Tesoreria de la Republica en pesos CLP105,000,000 5.10% 15/7/2050
133,264 0.00% Chile Government International Bond $200,000 3.10%
22/1/2061 130,907 0.00% Bonos de la Tesoreria de la Republica en pesos
CLP100,000,000 5.80% 1/6/2024 123,512 0.00% Chile Government
International Bond $150,000 3.63% 30/10/2042 121,567 0.00% Chile
Government International Bond €100,000 1.63% 30/1/2025 105,315 0.00%
Chile Government International Bond €100,000 1.30% 26/7/2036 78,767
0.00% Chile Government International Bond €100,000 1.25% 22/1/2051
56,916 0.00% Corp.
- >-
LLC $150,000 2.90% 1/3/2030 128,400 0.01% Burlington Northern Santa Fe
LLC $150,000 4.05% 15/6/2048 128,392 0.01% Leland Stanford Junior
University $150,000 3.65% 1/5/2048 128,280 0.01% Southern California
Edison Co. $175,000 3.60% 1/2/2045 128,168 0.01% John Deere Financial,
Inc. CAD195,000 1.34% 8/9/2027 127,858 0.01% Kraft Heinz Foods Co.
$150,000 4.38% 1/6/2046 127,812 0.01% Masco Corp. $150,000 1.50%
15/2/2028 127,754 0.01% Parker-Hannifin Corp. $150,000 4.10% 1/3/2047
127,588 0.01% Aircastle Ltd. $150,000 2.85% 26/1/2028 127,563 0.01%
UnitedHealth Group, Inc. $140,000 4.25% 15/3/2043 127,393 0.01% Amgen,
Inc. $140,000 2.20% 21/2/2027 127,198 0.01% Schlumberger Holdings Corp.
$135,000 3.90% 17/5/2028 127,179 0.01% Essential Utilities, Inc.
$150,000 2.70% 15/4/2030 127,082 0.01% Starbucks Corp. $150,000 2.25%
12/3/2030 126,940 0.01% Charles Schwab Corp. $125,000 5.85% 19/5/2034
126,868 0.01% Comcast Corp. $200,000 2.99% 1/11/2063 126,717 0.01%
Entergy Texas, Inc. $160,000 1.75% 15/3/2031 126,697 0.01% Exelon Corp.
$125,000 5.63% 15/6/2035 126,526 0.01% Uniform Mortgage Backed
Securities $123,205 6.50% 1/11/2052 126,499 0.01% Dell International
LLC/EMC Corp. $125,000 5.75% 1/2/2033 126,258 0.01% Government National
Mortgage Association $131,748 4.00% 20/3/2049 126,098 0.01% HCA, Inc.
$125,000 5.88% 1/2/2029 125,650 0.01% PG&E Wildfire Recovery Funding LLC
$132,193 3.59% 1/6/2030 125,330 0.01% STERIS Irish FinCo UnLtd Co.
$150,000 2.70% 15/3/2031 125,236 0.01% Uniform Mortgage Backed
Securities $137,046 3.50% 1/6/2050 125,181 0.01%
- >-
94 39,148 0.05% Teradyne, Inc. 350 38,965 0.05% Splunk, Inc. 363 38,511
0.05% Zoom Video Communications, Inc. Class A 562 38,149 0.05% Paycom
Software, Inc. 117 37,585 0.04% Entegris, Inc. 339 37,568 0.04% NetApp,
Inc. 480 36,672 0.04% Pinterest, Inc. Class A 1,326 36,253 0.04% PTC,
Inc. 243 34,579 0.04% Jabil, Inc. 288 31,084 0.04% Akamai Technologies,
Inc. 345 31,005 0.04% Lattice Semiconductor Corp. 310 29,782 0.04% SS&C
Technologies Holdings, Inc. 487 29,512 0.04% Zscaler, Inc. 198 28,967
0.03% Flex Ltd. 1,027 28,386 0.03% Unity Software, Inc. 648 28,136 0.03%
EPAM Systems, Inc. 125 28,094 0.03% Manhattan Associates, Inc. 138
27,583 0.03% Western Digital Corp. 726 27,537 0.03% Seagate Technology
Holdings plc 441 27,285 0.03% Amdocs Ltd. 272 26,887 0.03% Check Point
Software Technologies Ltd. 211 26,506 0.03% GoDaddy, Inc. Class A 347
26,070 0.03% Match Group, Inc. 620 25,947 0.03% Super Micro Computer,
Inc. 103 25,673 0.03% Open Text Corp. 613 25,525 0.03% Dynatrace, Inc.
495 25,478 0.03% Twilio, Inc. Class A 381 24,239 0.03% Gen Digital, Inc.
1,262 23,410 0.03% Qorvo, Inc. 228 23,263 0.03% Okta, Inc. Class A 335
23,232 0.03% Pure Storage, Inc. Class A 630 23,197 0.03% DocuSign, Inc.
Class A 452 23,093 0.03% Ceridian HCM Holding, Inc. 332 22,234 0.03%
Black Knight, Inc. 345 20,607 0.02% F5, Inc. 138 20,184 0.02% Vertiv
Holdings Co. Class A 743 18,404 0.02% Arrow Electronics, Inc. 127 18,190
0.02% Toast, Inc. Class A 799 18,033 0.02% ZoomInfo Technologies, Inc.
Class A 705 17,900 0.02% Globant SA 94 16,894 0.02% National Instruments
Corp. 288 16,531 0.02% Wolfspeed, Inc. 285 15,843 0.02% Dropbox, Inc.
Class A 592 15,789 0.02% Rambus, Inc. 246 15,786 0.02% SPS Commerce,
Inc. 81 15,557 0.02% Universal Display Corp. 105 15,134 0.02%
- source_sentence: >-
How does the diversification of investments across different currencies
impact financial risk?
sentences:
- >-
20/9/2023 4,504 0.00% GBP 305,720 USD (385,212) JPMorgan Chase Bank
20/9/2023 3,544 0.00% EUR 602,840 USD (659,854) State Street Bank &
Trust Co. 20/9/2023 435 0.00% JPY 67,590,000 USD (473,571) JPMorgan
Chase Bank 20/9/2023 (176) (0.00%) GBP 378,925 USD (483,052) State
Street Bank & Trust Co. 20/9/2023 (1,208) (0.00%) GBP 382,825 USD
(488,055) BNP Paribas 20/9/2023 (1,251) (0.00%) EUR 480,370 USD
(528,752) State Street Bank & Trust Co. 20/9/2023 (2,604) (0.00%) JPY
68,925,000 USD (489,188) State Street Bank & Trust Co. 20/9/2023 (6,443)
(0.00%) JPY 43,800,000 USD (319,166) JPMorgan Chase Bank 20/9/2023
(12,395) (0.00%) JPY 91,700,000 USD (657,807) JPMorgan Chase Bank
20/9/2023 (15,547) (0.00%) JPY 639,066,394 USD (4,648,059) JPMorgan
Chase Bank 20/9/2023 (172,087) (0.00%) Total OTC Financial Derivative
Instruments 545,977 0.00% Total Investments 17,991,067,179 98.73% Fair
Value US Dollars ($)% of Total Net Assets Other Assets and Liabilities
232,296,305 1.27% Net Assets 18,223,363,484 100.00%
- >-
$20,000 2.60% 1/5/2031 16,394 0.04% Wyeth LLC $15,000 5.95% 1/4/2037
16,387 0.04% Comcast Corp. $20,000 1.95% 15/1/2031 16,352 0.04% Wells
Fargo & Co. $20,000 4.40% 14/6/2046 16,296 0.04% Home Depot, Inc.
$20,000 1.88% 15/9/2031 16,269 0.04% Baxter International, Inc. $20,000
2.54% 1/2/2032 16,201 0.04% NIKE, Inc. $20,000 3.38% 27/3/2050 16,199
0.04% Citigroup, Inc. $15,000 6.68% 13/9/2043 16,179 0.04% Bank of
America Corp. $20,000 3.95% 23/1/2049 16,170 0.04% JPMorgan Chase & Co.
$20,000 3.90% 23/1/2049 16,163 0.04% BlackRock, Inc. $20,000 2.10%
25/2/2032 16,138 0.04% Goldman Sachs Group, Inc. $15,000 6.13% 15/2/2033
16,116 0.04% Lowe's Cos, Inc. $20,000 4.45% 1/4/2062 16,110 0.04%
UnitedHealth Group, Inc. $20,000 3.70% 15/8/2049 16,101 0.04% Lowe's
Cos, Inc. $20,000 4.05% 3/5/2047 16,078 0.04% Bristol-Myers Squibb Co.
$20,000 1.45% 13/11/2030 16,065 0.04% Amazon.com, Inc. $25,000 2.70%
3/6/2060 16,054 0.04% US Bancorp $20,000 2.68% 27/1/2033 16,035 0.04%
Bank of America Corp. $15,000 5.88% 7/2/2042 15,990 0.04% Bank of
America Corp. $20,000 2.30% 21/7/2032 15,988 0.04% General Motors
Financial Co., Inc. $20,000 2.70% 10/6/2031 15,945 0.04% Comcast Corp.
$20,000 1.50% 15/2/2031 15,918 0.04% Newmont Corp. $15,000 6.25%
1/10/2039 15,854 0.04% Paramount Global $15,000 7.88% 30/7/2030 15,846
0.04% Gilead Sciences, Inc. $15,000 5.65% 1/12/2041 15,767 0.04% United
Parcel Service, Inc. $15,000 5.30% 1/4/2050 15,759 0.04% Comcast Corp.
$15,000 5.65% 15/6/2035 15,725 0.04% VMware, Inc. $20,000 2.20%
15/8/2031 15,716 0.04% Oracle Corp. $20,000 4.13% 15/5/2045 15,702 0.04%
Hewlett Packard Enterprise Co. $15,000 6.35% 15/10/2045 15,617 0.04%
Alphabet, Inc.
- >-
In addition, the restriction on liens in the GSFC 2008 Indenture applies
only to liens that secure debt for borrowed money. For example, liens
imposed by operation of law, such as liens to secure statutory
obligations for taxes or workers’ compensation benefits, or liens the
Company creates to secure obligations to pay legal judgments or surety
bonds, would not be covered by this restriction. Modification of the
Debt Indenture and Waiver of Covenants There are four types of changes
GSFC and the Company can make to the GSFC 2008 Indenture and the debt
securities or series of debt securities and related guarantees issued
under the GSFC 2008 Indenture. Changes Requiring Each Holder’s Approval
First, there are changes that cannot be made without the approval of the
holder of each debt security affected by the change under the GSFC 2008
Indenture. Here is a list of those types of changes: • change the stated
maturity for any principal or interest payment on a debt security; •
reduce the principal amount, the amount payable on acceleration of the
stated maturity after a default, the interest rate or the redemption
price for a debt security; • permit redemption of a debt security if not
previously permitted; • impair any right a holder may have to require
repayment of its debt security; • change the currency of any payment on
a debt security; • change the place of payment on a debt security; •
impair a holder’s right to sue for payment of any amount due on its debt
security; • reduce the percentage in principal amount of the debt
securities of any one or more affected series, taken • separately or
together, as applicable, and whether comprising the same or different
series or less than all of the debt securities of a series, the approval
of whose holders is needed to change the applicable debt indenture or
those debt securities; • reduce the percentage in principal amount of
the debt securities of any one or more affected series, taken separately
or together, as applicable, and whether comprising the same or different
series or less than all of the debt securities of a series, the consent
of whose holders is needed to waive GSFC’s compliance with the
applicable debt indenture or to waive defaults; and • change the
provisions of the applicable debt indenture dealing with modification
and waiver in any other respect, except to increase any required
percentage referred to above or to add to -59-
datasets:
- sujet-ai/Sujet-Financial-RAG-EN-Dataset
pipeline_tag: sentence-similarity
library_name: sentence-transformers
metrics:
- cosine_accuracy@1
- cosine_accuracy@3
- cosine_accuracy@5
- cosine_accuracy@10
- cosine_precision@1
- cosine_precision@3
- cosine_precision@5
- cosine_precision@10
- cosine_recall@1
- cosine_recall@3
- cosine_recall@5
- cosine_recall@10
- cosine_ndcg@10
- cosine_mrr@10
- cosine_map@100
model-index:
- name: SentenceTransformer based on nomic-ai/modernbert-embed-base
results:
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: ModernFinBERT RAG embed base
type: ModernFinBERT-RAG-embed-base
metrics:
- type: cosine_accuracy@1
value: 0.3812677388836329
name: Cosine Accuracy@1
- type: cosine_accuracy@3
value: 0.6329233680227058
name: Cosine Accuracy@3
- type: cosine_accuracy@5
value: 0.7123935666982024
name: Cosine Accuracy@5
- type: cosine_accuracy@10
value: 0.7918637653736992
name: Cosine Accuracy@10
- type: cosine_precision@1
value: 0.3812677388836329
name: Cosine Precision@1
- type: cosine_precision@3
value: 0.2109744560075686
name: Cosine Precision@3
- type: cosine_precision@5
value: 0.1424787133396405
name: Cosine Precision@5
- type: cosine_precision@10
value: 0.07918637653736992
name: Cosine Precision@10
- type: cosine_recall@1
value: 0.3812677388836329
name: Cosine Recall@1
- type: cosine_recall@3
value: 0.6329233680227058
name: Cosine Recall@3
- type: cosine_recall@5
value: 0.7123935666982024
name: Cosine Recall@5
- type: cosine_recall@10
value: 0.7918637653736992
name: Cosine Recall@10
- type: cosine_ndcg@10
value: 0.5891686849331125
name: Cosine Ndcg@10
- type: cosine_mrr@10
value: 0.5239367932603505
name: Cosine Mrr@10
- type: cosine_map@100
value: 0.5297544273648861
name: Cosine Map@100
SentenceTransformer based on nomic-ai/modernbert-embed-base
This is a sentence-transformers model finetuned from nomic-ai/modernbert-embed-base on the sujet-financial-rag-en-dataset dataset. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
Model Details
Model Description
- Model Type: Sentence Transformer
- Base model: nomic-ai/modernbert-embed-base
- Maximum Sequence Length: 8192 tokens
- Output Dimensionality: 768 dimensions
- Similarity Function: Cosine Similarity
- Training Dataset:
- Language: en
Model Sources
- Documentation: Sentence Transformers Documentation
- Repository: Sentence Transformers on GitHub
- Hugging Face: Sentence Transformers on Hugging Face
Full Model Architecture
SentenceTransformer(
(0): Transformer({'max_seq_length': 8192, 'do_lower_case': False}) with Transformer model: ModernBertModel
(1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
(2): Normalize()
)
Usage
Direct Usage (Sentence Transformers)
First install the Sentence Transformers library:
pip install -U sentence-transformers
Then you can load this model and run inference.
from sentence_transformers import SentenceTransformer
# Download from the 🤗 Hub
model = SentenceTransformer("sujet-ai/Fin-ModernBERT-RAG-base")
# Run inference
sentences = [
'How does the diversification of investments across different currencies impact financial risk?',
'20/9/2023 4,504 0.00% GBP 305,720 USD (385,212) JPMorgan Chase Bank 20/9/2023 3,544 0.00% EUR 602,840 USD (659,854) State Street Bank & Trust Co. 20/9/2023 435 0.00% JPY 67,590,000 USD (473,571) JPMorgan Chase Bank 20/9/2023 (176) (0.00%) GBP 378,925 USD (483,052) State Street Bank & Trust Co. 20/9/2023 (1,208) (0.00%) GBP 382,825 USD (488,055) BNP Paribas 20/9/2023 (1,251) (0.00%) EUR 480,370 USD (528,752) State Street Bank & Trust Co. 20/9/2023 (2,604) (0.00%) JPY 68,925,000 USD (489,188) State Street Bank & Trust Co. 20/9/2023 (6,443) (0.00%) JPY 43,800,000 USD (319,166) JPMorgan Chase Bank 20/9/2023 (12,395) (0.00%) JPY 91,700,000 USD (657,807) JPMorgan Chase Bank 20/9/2023 (15,547) (0.00%) JPY 639,066,394 USD (4,648,059) JPMorgan Chase Bank 20/9/2023 (172,087) (0.00%) Total OTC Financial Derivative Instruments 545,977 0.00% Total Investments 17,991,067,179 98.73% Fair Value US Dollars ($)% of Total Net Assets Other Assets and Liabilities 232,296,305 1.27% Net Assets 18,223,363,484 100.00%',
'In addition, the restriction on liens in the GSFC 2008 Indenture applies only to liens that secure debt for borrowed money. For example, liens imposed by operation of law, such as liens to secure statutory obligations for taxes or workers’ compensation benefits, or liens the Company creates to secure obligations to pay legal judgments or surety bonds, would not be covered by this restriction. Modification of the Debt Indenture and Waiver of Covenants There are four types of changes GSFC and the Company can make to the GSFC 2008 Indenture and the debt securities or series of debt securities and related guarantees issued under the GSFC 2008 Indenture. Changes Requiring Each Holder’s Approval First, there are changes that cannot be made without the approval of the holder of each debt security affected by the change under the GSFC 2008 Indenture. Here is a list of those types of changes: • change the stated maturity for any principal or interest payment on a debt security; • reduce the principal amount, the amount payable on acceleration of the stated maturity after a default, the interest rate or the redemption price for a debt security; • permit redemption of a debt security if not previously permitted; • impair any right a holder may have to require repayment of its debt security; • change the currency of any payment on a debt security; • change the place of payment on a debt security; • impair a holder’s right to sue for payment of any amount due on its debt security; • reduce the percentage in principal amount of the debt securities of any one or more affected series, taken • separately or together, as applicable, and whether comprising the same or different series or less than all of the debt securities of a series, the approval of whose holders is needed to change the applicable debt indenture or those debt securities; • reduce the percentage in principal amount of the debt securities of any one or more affected series, taken separately or together, as applicable, and whether comprising the same or different series or less than all of the debt securities of a series, the consent of whose holders is needed to waive GSFC’s compliance with the applicable debt indenture or to waive defaults; and • change the provisions of the applicable debt indenture dealing with modification and waiver in any other respect, except to increase any required percentage referred to above or to add to -59-',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 768]
# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]
Evaluation
Metrics
Information Retrieval
- Dataset:
ModernFinBERT-RAG-embed-base - Evaluated with
InformationRetrievalEvaluator
| Metric | Value |
|---|---|
| cosine_accuracy@1 | 0.3813 |
| cosine_accuracy@3 | 0.6329 |
| cosine_accuracy@5 | 0.7124 |
| cosine_accuracy@10 | 0.7919 |
| cosine_precision@1 | 0.3813 |
| cosine_precision@3 | 0.211 |
| cosine_precision@5 | 0.1425 |
| cosine_precision@10 | 0.0792 |
| cosine_recall@1 | 0.3813 |
| cosine_recall@3 | 0.6329 |
| cosine_recall@5 | 0.7124 |
| cosine_recall@10 | 0.7919 |
| cosine_ndcg@10 | 0.5892 |
| cosine_mrr@10 | 0.5239 |
| cosine_map@100 | 0.5298 |
Training Details
Training Dataset
sujet-financial-rag-en-dataset
- Dataset: sujet-financial-rag-en-dataset at ec52315
- Size: 104,601 training samples
- Columns:
anchorandpositive - Approximate statistics based on the first 1000 samples:
anchor positive type string string details - min: 13 tokens
- mean: 24.56 tokens
- max: 50 tokens
- min: 23 tokens
- mean: 647.39 tokens
- max: 1165 tokens
- Samples:
anchor positive How does the Compensation Committee's role influence the stock awards granted to executive officers?PART II Item 8 88 Stock Plans Stock awards entitle the holder to receive shares of Microsoft common stock as the award vests. Stock awards generally vest over a service period of four years or five years. Executive Incentive Plan Under the Executive Incentive Plan, the Compensation Committee approves stock awards to executive officers and certain senior executives. RSUs generally vest ratably over a service period of four years. PSUs generally vest over a performance period of thre e years. The number of shares the PSU holder receives is based on the extent to which the corresponding performance goals have been achieved. Activity for All Stock Plans The fair value of stock awards was estimated on the date of grant using the following assumptions: Year ended June 30, 2023 2022 2021 Dividends per share (quarterly amounts) $ 0.62 – 0.68 $ 0.56 – 0.62 $ 0.51 – 0.56 Interest rates 2.0% – 5.4% 0.03% – 3.6% 0.01% – 1.5% During fiscal year 2023 , the following activity occurred under our stock...What is the fair value of the bond issued by CVS Health Corp., and how does it compare to the fair value of the bond issued by Walt Disney Co.?445 Vanguard ESG Global Corporate Bond UCITS ETF Principal CouponMaturity DateFair Value US Dollars ($)% of Total Net Assets State Street Corp. $50,000 4.82% 26/1/2034 48,557 0.01% Baxalta, Inc. $50,000 4.00% 23/6/2025 48,515 0.01% Starbucks Corp. $50,000 3.80% 15/8/2025 48,426 0.01% Citigroup, Inc. $50,000 4.60% 9/3/2026 48,387 0.01% Athene Global Funding CAD70,000 2.10% 24/9/2025 48,344 0.01% Bank of America Corp. $50,000 4.25% 22/10/2026 48,257 0.01% PepsiCo, Inc. $50,000 3.60% 18/2/2028 48,191 0.01% Charles Schwab Corp. $50,000 3.85% 21/5/2025 48,183 0.01% JPMorgan Chase & Co. $50,000 4.13% 15/12/2026 48,165 0.01% Charter Communications Operating LLC/Charter Communications Operating Capital $60,000 5.50% 1/4/2063 48,151 0.01% US Bancorp $60,000 2.68% 27/1/2033 48,106 0.01% Chubb INA Holdings, Inc. $50,000 3.35% 3/5/2026 48,074 0.01% Bank of New York Mellon Corp. $50,000 3.00% 24/2/2025 48,071 0.01% Truist Financial Corp. $50,000 4.87% 26/1/2029 48,042 0.01% Truist Financial Corp. $...Analyze the impact of currency fluctuations on the unrealized gains and losses reported in the forward currency exchange contracts.15,216 141,230 0.01% Samsung Fire & Marine Insurance Co., Ltd. - Preference Shares 1,056 137,365 0.01% Samsung SDI Co., Ltd. - Preference Shares 546 133,014 0.01% NHN Corp. 7,096 132,480 0.01% Hanwha Corp. - Preference Shares 10,137 114,475 0.01% Amorepacific Corp. - Preference Shares 4,230 101,123 0.01% CJ CheilJedang Corp. - Preference Shares 576 59,276 0.00% Hanwha Galleria Corp. 47,521 54,711 0.00% - - 386,394,890 29.25% Total Equities 1,291,387,033 97.75% Total Transferable Securities 1,291,387,033 97.75% Number of Contracts Long/ (Short)Notional Amount Unrealised Gain/(Loss) US Dollar s ($)% of Total Net Assets Financial Derivative Instruments Dealt in on a Regulated Market (0.02%) (30 June 2022: (0.00%)) Futures (0.02%) (30 June 2022: (0.00%)) MSCI Pacific Ex-Japan Index September 2023 283 $20,595,251 (131,521) (0.01%) KOSPI 200 Index September 2023 138 KRW11,933,318,478 (141,212) (0.01%) Total Financial Derivative Instruments Dealt in on a Regulated Market (272,733) (0.02%) OTC... - Loss:
MultipleNegativesRankingLosswith these parameters:{ "scale": 20.0, "similarity_fct": "cos_sim" }
Evaluation Dataset
sujet-financial-rag-en-dataset
- Dataset: sujet-financial-rag-en-dataset at ec52315
- Size: 1,057 evaluation samples
- Columns:
anchorandpositive - Approximate statistics based on the first 1000 samples:
anchor positive type string string details - min: 13 tokens
- mean: 24.64 tokens
- max: 52 tokens
- min: 26 tokens
- mean: 647.51 tokens
- max: 1081 tokens
- Samples:
anchor positive What was the net asset value per share for the EUR Distributing class as of 30 June 2022?The accompanying notes form an integral part of the financial statements.559 Vanguard EUR Eurozone Government Bond UCITS ETFStatement of Assets and Liabilities EUR (€) EUR (€) As at 30 June As at 30 June Note 2023 2022 Current Assets Financial Assets at Fair Value Through Profit or Loss: Transferable Securities 3,17 1,719,130,585 1,249,469,080 Financial Derivative Instruments 3,17 — 23,742 Cash 3 11,990,422 14,558,520 Receivables: Interest and Dividends 12,715,254 5,193,434 Capital Shares Issued 27 9,190,562 Investments Sold 6,621,764 499,630 Margin Cash Due from Broker 3 3 56,198 Total Current Assets 1,750,458,055 1,278,991,166 Current Liabilities Financial Liabilities at Fair Value Through Profit or Loss: Financial Derivative Instruments 3,17 — 17,321 Bank Overdraft — 6,668 Payables and Other Liabilities: Capital Shares Redeemed 5,790,847 6,811,068 Investments Purchased 8,942,689 15,381,189 Management Fees Payable 12 99,689 69,769 Total Current Liabilities 14,833,225 22,286,015 Net A...What factors could lead the Committee to determine that an employee's actions have resulted in a "material adverse impact" on the broader financial system?Definitions Appendix The following capitalized terms are used in this Award Agreement with the following meanings: (a)“409A Deferred Compensation ” means a “deferral of compensation” or “deferred compensation” as those terms are defined in the regulations under Section 409A. (b)“Conflicted Employment ” means your employment at any U.S. Federal, state or local government, any non-U.S. government, any supranational or international organization, any self- regulatory organization, or any agency or instrumentality of any such government or organization, or any other employer (other than an “Accounting Firm” within the meaning of SEC Rule 2-01(f)(2) of Regulation S-X or any successor thereto) determined by the Committee, if, as a result of such employment, your continued holding of any Outstanding Short-Term RSUs would result in an actual or perceived conflict of interest. (c)“Failed to Consider Risk ” means that you participated (or otherwise oversaw or were responsible for, depending on t...What financial implications could arise from a decrease in the pool of qualified drivers for a ridesharing platform?In addition, changes in certain laws and regulations, including immigration, labor and employment laws or background check requirements, may result in a shift or decrease in the pool of qualified drivers, which may result in increased competition for qualified drivers or higher costs of recruitment, operation and retention. As part of our business operations or research and development efforts, data on the vehicle may be collected and drivers may be uncomfortable or unwilling to drive knowing that data is being collected. Other factors outside of our control, such as concerns about personal health and safety, increases in the price of gasoline, vehicles or insurance, or concerns about the availability of government or other assistance programs if drivers continue to drive on our platform, may also reduce the number of drivers on our platform or their utilization of our platform, or impact our ability to onboard new drivers. If we fail to attract qualified drivers on favorable terms, fa... - Loss:
MultipleNegativesRankingLosswith these parameters:{ "scale": 20.0, "similarity_fct": "cos_sim" }
Training Hyperparameters
Non-Default Hyperparameters
eval_strategy: stepsper_device_train_batch_size: 64per_device_eval_batch_size: 64gradient_accumulation_steps: 8learning_rate: 0.0002num_train_epochs: 2lr_scheduler_type: cosinewarmup_ratio: 0.1bf16: Truetf32: Trueload_best_model_at_end: Trueoptim: adamw_torch_fusedbatch_sampler: no_duplicates
All Hyperparameters
Click to expand
overwrite_output_dir: Falsedo_predict: Falseeval_strategy: stepsprediction_loss_only: Trueper_device_train_batch_size: 64per_device_eval_batch_size: 64per_gpu_train_batch_size: Noneper_gpu_eval_batch_size: Nonegradient_accumulation_steps: 8eval_accumulation_steps: Nonetorch_empty_cache_steps: Nonelearning_rate: 0.0002weight_decay: 0.0adam_beta1: 0.9adam_beta2: 0.999adam_epsilon: 1e-08max_grad_norm: 1.0num_train_epochs: 2max_steps: -1lr_scheduler_type: cosinelr_scheduler_kwargs: {}warmup_ratio: 0.1warmup_steps: 0log_level: passivelog_level_replica: warninglog_on_each_node: Truelogging_nan_inf_filter: Truesave_safetensors: Truesave_on_each_node: Falsesave_only_model: Falserestore_callback_states_from_checkpoint: Falseno_cuda: Falseuse_cpu: Falseuse_mps_device: Falseseed: 42data_seed: Nonejit_mode_eval: Falseuse_ipex: Falsebf16: Truefp16: Falsefp16_opt_level: O1half_precision_backend: autobf16_full_eval: Falsefp16_full_eval: Falsetf32: Truelocal_rank: 0ddp_backend: Nonetpu_num_cores: Nonetpu_metrics_debug: Falsedebug: []dataloader_drop_last: Falsedataloader_num_workers: 0dataloader_prefetch_factor: Nonepast_index: -1disable_tqdm: Falseremove_unused_columns: Truelabel_names: Noneload_best_model_at_end: Trueignore_data_skip: Falsefsdp: []fsdp_min_num_params: 0fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}fsdp_transformer_layer_cls_to_wrap: Noneaccelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}deepspeed: Nonelabel_smoothing_factor: 0.0optim: adamw_torch_fusedoptim_args: Noneadafactor: Falsegroup_by_length: Falselength_column_name: lengthddp_find_unused_parameters: Noneddp_bucket_cap_mb: Noneddp_broadcast_buffers: Falsedataloader_pin_memory: Truedataloader_persistent_workers: Falseskip_memory_metrics: Trueuse_legacy_prediction_loop: Falsepush_to_hub: Falseresume_from_checkpoint: Nonehub_model_id: Nonehub_strategy: every_savehub_private_repo: Nonehub_always_push: Falsegradient_checkpointing: Falsegradient_checkpointing_kwargs: Noneinclude_inputs_for_metrics: Falseinclude_for_metrics: []eval_do_concat_batches: Truefp16_backend: autopush_to_hub_model_id: Nonepush_to_hub_organization: Nonemp_parameters:auto_find_batch_size: Falsefull_determinism: Falsetorchdynamo: Noneray_scope: lastddp_timeout: 1800torch_compile: Falsetorch_compile_backend: Nonetorch_compile_mode: Nonedispatch_batches: Nonesplit_batches: Noneinclude_tokens_per_second: Falseinclude_num_input_tokens_seen: Falseneftune_noise_alpha: Noneoptim_target_modules: Nonebatch_eval_metrics: Falseeval_on_start: Falseuse_liger_kernel: Falseeval_use_gather_object: Falseaverage_tokens_across_devices: Falseprompts: Nonebatch_sampler: no_duplicatesmulti_dataset_batch_sampler: proportional
Training Logs
| Epoch | Step | Training Loss | Validation Loss | ModernFinBERT-RAG-embed-base_cosine_ndcg@10 |
|---|---|---|---|---|
| 0 | 0 | - | - | 0.2812 |
| 0.0489 | 10 | 1.8949 | - | - |
| 0.0979 | 20 | 1.0738 | - | - |
| 0.1468 | 30 | 0.9147 | - | - |
| 0.1957 | 40 | 0.8194 | - | - |
| 0.2446 | 50 | 0.7847 | - | - |
| 0.2936 | 60 | 0.7428 | - | - |
| 0.3425 | 70 | 0.7587 | - | - |
| 0.3914 | 80 | 0.7769 | - | - |
| 0.4404 | 90 | 0.7319 | - | - |
| 0.4893 | 100 | 0.7199 | 0.7262 | 0.5395 |
| 0.5382 | 110 | 0.7085 | - | - |
| 0.5872 | 120 | 0.6726 | - | - |
| 0.6361 | 130 | 0.6954 | - | - |
| 0.6850 | 140 | 0.65 | - | - |
| 0.7339 | 150 | 0.6207 | - | - |
| 0.7829 | 160 | 0.6518 | - | - |
| 0.8318 | 170 | 0.6227 | - | - |
| 0.8807 | 180 | 0.6285 | - | - |
| 0.9297 | 190 | 0.6235 | - | - |
| 0.9786 | 200 | 0.6183 | 0.6158 | 0.5546 |
| 1.0294 | 210 | 0.6036 | - | - |
| 1.0783 | 220 | 0.5818 | - | - |
| 1.1272 | 230 | 0.5445 | - | - |
| 1.1761 | 240 | 0.5115 | - | - |
| 1.2251 | 250 | 0.4712 | - | - |
| 1.2740 | 260 | 0.449 | - | - |
| 1.3229 | 270 | 0.4457 | - | - |
| 1.3719 | 280 | 0.4763 | - | - |
| 1.4208 | 290 | 0.449 | - | - |
| 1.4697 | 300 | 0.4352 | 0.5674 | 0.5797 |
| 1.5187 | 310 | 0.4173 | - | - |
| 1.5676 | 320 | 0.4198 | - | - |
| 1.6165 | 330 | 0.3901 | - | - |
| 1.6654 | 340 | 0.4066 | - | - |
| 1.7144 | 350 | 0.3802 | - | - |
| 1.7633 | 360 | 0.3712 | - | - |
| 1.8122 | 370 | 0.3983 | - | - |
| 1.8612 | 380 | 0.3886 | - | - |
| 1.9101 | 390 | 0.4027 | - | - |
| 1.959 | 400 | 0.398 | 0.5435 | 0.5892 |
- The bold row denotes the saved checkpoint.
Framework Versions
- Python: 3.10.13
- Sentence Transformers: 3.3.1
- Transformers: 4.48.0.dev0
- PyTorch: 2.5.1+cu124
- Accelerate: 1.0.1
- Datasets: 3.2.0
- Tokenizers: 0.21.0
Citation
BibTeX
Sentence Transformers
@inproceedings{reimers-2019-sentence-bert,
title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
author = "Reimers, Nils and Gurevych, Iryna",
booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
month = "11",
year = "2019",
publisher = "Association for Computational Linguistics",
url = "https://arxiv.org/abs/1908.10084",
}
MultipleNegativesRankingLoss
@misc{henderson2017efficient,
title={Efficient Natural Language Response Suggestion for Smart Reply},
author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
year={2017},
eprint={1705.00652},
archivePrefix={arXiv},
primaryClass={cs.CL}
}