Ai4Users.comLocal AI & LLM community
Sign in to contributeSign in

Qwen 3.6 27B FP8 Instruct | Benchmark #83

Described in:Qwen 3.6 27B on FinQA: financial benchmark results and dataset fixes

Benchmark summary

Financial Reasoning Benchmark based on FinQA

ModelQwen 3.6 27B QuantizationFP8 ModeInstruct

FinQA-based benchmark for numerical reasoning over financial reports, ported to the SC# evaluation runtime. Each test gives the model an excerpt from a company's annual report, with text and tables, and asks a question that needs the right figures and a correct calculation. During migration we checked every disputed task by hand: wrong FinQA reference answers were corrected and ambiguous questions were clarified.

Score 1105/1123 98.4% passed
1105 passed18 failed2 skipped1125 total 1123 AI queries 0 tool calls TOKENS IN2 510 516 TOKENS OUT663 640

Results by difficulty

3 groups
Level Medium
635 / 643 98.8%
passed
643 AI queries 0 tool calls IN1 442 258 OUT376 901
Level Hard
445 / 454 98.0%
passed
454 AI queries 0 tool calls IN1 016 734 OUT269 404
Level VeryHard
25 / 26 96.2%
passed
26 AI queries 0 tool calls IN51 524 OUT17 335

Results by category

2 groups
Category ContextProcessing
98.4% 1105/1123 passed
1123 AI queries 0 tool calls TOKENS IN2 510 516 TOKENS OUT663 640
Category Reasoning
98.4% 1105/1123 passed
1123 AI queries 0 tool calls TOKENS IN2 510 516 TOKENS OUT663 640

Tests with multiple category tags are counted in each matching category, so category totals may exceed the report total.

Benchmark items
Script / test Status Tokens
Reasoning - FinQA annual report calculations (set 1) 32 passed1 failed
97.0%
 IN73 905 OUT16 321
✓
FinQaAal2016FlightAttendantsMaintenancewhat is the ratio of the total flight attendants to total maintenance personnel1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 216 OUT307
✓
FinQaAapl2006GreatestProvisionIncomewhat was the greatest provision for income taxes , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 026 OUT179
✓
FinQaAdbe2008CombinedAccruedInterestthe combined amount of accrued interest and penalties related to tax positions taken on our tax returns and included in non-current income taxes payable was what percent of the total ending balance as of november 28 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 223 OUT804
✓
FinQaAdbe2008GrossLiabilityUnrecognizedwhat is the percentage change in the the gross liability for unrecognized tax benefits during 2008 compare to 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 206 OUT293
✓
FinQaAdi2011CashFlowHedgeswhat is the percentage change in cash flow hedges in 2011 compare to the 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 425 OUT471
✓
FinQaAes2010RecourseDebtCurrentwhat percent of total recourse debt is current?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 109 OUT515
×
FinQaAlxn2016BorrowingUnderTermwhat is the borrowing under the term loan facility as a percentage of the total contractual maturities of long-term debt obligations due subsequent to december 31 , 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
Assertion expression evaluated to false: difference <= tolerance Context: answer: 0.6047, expected: 1.13599 Values: difference = 0.53129 tolerance = 0.011359900000000001
 Failed IN2 429 OUT366
✓
FinQaAmt2016QuarterEndedMarchfor the quarter ended march 312015 what was the percentage change in the share price from the highest to the lowest1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 048 OUT1 008
✓
FinQaAwk2014DeferredTaxAssetswhat was the percentage change in deferred tax assets and regulatory assets from 2013 to 20141 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 240 OUT408
✓
FinQaC2009NetInterestRevenuewhat percent of net interest revenue where total operating expenses in 2009?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 922 OUT685
✓
FinQaCmcsa2015UnrecognizedTaxBenefitswhat was the change in unrecognized tax benefits from the end of 2014 to the end of 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 287 OUT987
✓
FinQaDg2005ImpairmentCostsRecordedwhat was the total impairment costs recorded from 2003 to 2005 in millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 296 OUT553
✓
FinQaEtfc2007DecemberSquareFootageas of december 2007 what was the ratio of the square footage in alpharetta georgia to charlotte north carolina1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 305 OUT675
✓
FinQaEtr2016NetRevenueEntergywhat is the net change in net revenue during 2015 for entergy corporation?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 144 OUT397
✓
FinQaEtr2017NetRevenuewhat was the average net revenue between 2016 and 2017 in millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 713 OUT241
✓
FinQaFis2010PurchasePriceRelatedwhat portion of total purchase price is related to stock awards?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 956 OUT319
✓
FinQaFis2016CumulativeShareholderReturnwhat was the difference in percentage cumulative 5-year total shareholder return on common stock fidelity national information services , inc . compared to the s&p 500 for the period ending 12/16?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN1 699 OUT465
✓
FinQaGis2018NoncancelableFutureLeasewhat portion of the total noncancelable future lease commitments are due in fiscal year of 2019?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 037 OUT1 570
✓
FinQaGpn2010IncomeTaxBenefitin 2010 what was the percent of the income tax benefit to the stock based compensation cost1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 179 OUT732
✓
FinQaGs2015FutureMinimumRentalwhat percentage of future minimum rental payments are due in 2018?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 282 OUT248
✓
FinQaIntc2015FacilitiesMeasuredSquarewhat percentage of total facilities as measured in square feet are leased?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 990 OUT360
✓
FinQaJkhy2019FiveReturnPeerwas the five year total return of the 2019 peer group greater than the 2018 peer group?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 045 OUT322
✓
FinQaJpm2010FairAssetsSegregatedin 2010 and 2009 , what was the total fair value in billions of assets segregated for the benefit of securities and futures brokerage customers?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 567 OUT322
✓
FinQaJpm2018CibMarketsNetin 2018 what was the percent of the cib markets net interest income as part of the managed interest income1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN3 685 OUT434
✓
FinQaMo2016AltriaOutperformdid altria outperform the s&p 500?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 082 OUT338
✓
FinQaMro2011NetAnnualDiscountedwhat was the average net annual change in discounted future net cash flows ( in millions ) for the years 2011 , 2010 , and 2009?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 775 OUT336
✓
FinQaPnc2012CommercialMortgageLoanswhat was the percentage change in the commercial mortgage loans designated for sale at fair value from 2008 to 20091 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 525 OUT404
✓
FinQaPnc2012WouldFairSecuritieswhat would the fair value of total securities available for sale be without the fair value of securities classified as corporate stocks as of december 31 , 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 465 OUT861
✓
FinQaRcl2012AssumingEachContinentassuming each continent has the same number of destinations , approximately how many destinations does each continent have?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 360 OUT91
✓
FinQaStt2007GrowthBalanceStandbywhat is the growth rate in the balance of standby letters of credit from 2006 to 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 119 OUT264
✓
FinQaSyy2006RentalExpenseUnderwhat was the percentage change in total rental expense under operating leases from july 2 , 2005 to july 1 , 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 658 OUT441
✓
FinQaUaa2016DebtAssetwhat is the debt-to-asset ratio?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 686 OUT561
✓
FinQaUnp2015OperatingRevenuesAssociatedin 2015 what was the percent of the total operating revenues associated with agriculture products1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 206 OUT364
Reasoning - FinQA annual report calculations (set 10) 32 passed1 failed
97.0%
 IN73 932 OUT18 880
✓
FinQaAmt2008NetBalanceLiabilitywhat is the net change in the balance of liability related to employee separations during 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN3 448 OUT937
✓
FinQaAwk2013DecemberInterestPenaltyas of december 31.2013 what was the ratio of the interest and penalty as a percent of the total unrecognized tax benefits1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 097 OUT292
✓
FinQaCb2008StatutoryCapitalSurplusin 2009 what was the ratio of the statutory capital and surplus to the statutory net income of the bermuda subsidiaries1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 330 OUT2 763
✓
FinQaCdw2015AntiDilutiveCommonif the anti-dilutive common shares were not excluded from the diluted weighted-average shares outstanding for the year ended december 31 , 2015 , what would the total diluted weighted-average shares outstanding be , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 285 OUT305
✓
FinQaCdw2017GrossMargin2what was 2016 gross margin percent?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 986 OUT451
✓
FinQaDvn2015VolatilityFactorwhat was the percent change in the volatility factor from 2013 to 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 194 OUT822
✓
FinQaEtfc2012Ottiwhat was the change in otti between 2011 and 2012 , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 979 OUT1 096
✓
FinQaEtr2011EntergyCorporationSubsidiarieswhat was the percent of the change in the entergy corporation and subsidiaries net revenue in 20111 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 876 OUT312
✓
FinQaFis2016CumulativeShareholderReturn2what was the percentage cumulative 5-year total shareholder return on common stock fidelity national information services , inc . for the period ending 12/16?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 688 OUT301
✓
FinQaFis2017IncreaseDecreaseWouldwhat percent of the total increase or decrease would the euro be in 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 122 OUT260
×
FinQaGpn2010FairNonVested2what is the total fair value of non-vested shares as of may 31 , 2010 , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
Assertion expression evaluated to false: difference <= tolerance Context: answer: 29.946, expected: 29946 Values: difference = 29916.054 tolerance = 299.46
 Failed IN2 166 OUT2 008
✓
FinQaGrmn2006ConsideringPaymentsDueconsidering the payments due to less than a year , what is the percentage of purchase obligations concerning the total expenses?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 002 OUT336
✓
FinQaGs2013FiveReturnGoldmanwhat is the five year total return on the goldman sachs group inc.?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 888 OUT383
✓
FinQaGs2013NetEffectAdjustmentwhat is the net effect of adjustment from common shareholders 2019 equity to basel iii cet1?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 371 OUT400
✓
FinQaIp2009RentIncreasewhat was the percentage rent increase between 2007 and 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 703 OUT332
✓
FinQaIpg2006InterestExpenseAvoidedwhat amount of interest expense was avoided per year by switching the 201c4.50% ( 201c4.50 % ) notes 201d with the 201c4.25% ( 201c4.25 % ) notes 201d?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 623 OUT358
✓
FinQaJpm2003FirmCommitmentsProvidewhat was the ratio of the firm commitments to provide liquidity on asset- specific basis in 2003 compared to 2002 $ 18.0 billion at december 31 , 2003 , and $ 23.5 billion at december 31 , 20021 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 821 OUT399
✓
FinQaJpm2008DecemberAuthorizedRepurchaseas of december 31 , 2008 , what percentage of authorized repurchase capacity remained under the current stock repurchase program ?:1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 656 OUT328
✓
FinQaLkq2016RentalExpenseOperatingwhat was the percentage change in rental expense for operating leases from 2014 to 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 893 OUT454
✓
FinQaMas2017CommonStockMascowhat was the ratio of the value of the common stock masco to s&p 500 index in 20151 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 835 OUT286
✓
FinQaMmm2007RespiratorMaskAsbestoswhat is the ratio of the respirator mask/asbestos receivables to respirator mask/asbestos liabilities in 20071 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 380 OUT456
✓
FinQaMro2017InitialHealthCarewhat was the average initial health care trend rate for the three year period in%?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 462 OUT532
✓
FinQaMs2013ConsumerRelatedLoansconsumer related loans make up how much of the companies total corporate lending exposure?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 060 OUT494
✓
FinQaPnc2012CommercialMortgageRecoursefor 2011 and 2012 , what were average commercial mortgage recourse obligations in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 371 OUT454
✓
FinQaRsg2009GrowthDividendYieldwhat was the percentage growth in the dividend yield from 2007 to 20081 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 879 OUT383
✓
FinQaSlb2012WouldSharesOutstandingwhat would the 2012 shares outstanding in millions have been without the acquisition of smith international?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 723 OUT1 148
✓
FinQaSlg2011NumberSharesVestedwhat was the total number of shares vested during the three year period?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN3 448 OUT252
✓
FinQaSna2013AllowancesDoubtfulAccountsin 2013 what was the percent of the allowances for doubtful accounts1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 108 OUT267
✓
FinQaSyy2005PensionBenefitsPaidwhat is the percentage change in pension benefits to be paid between 2006 and 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 222 OUT479
✓
FinQaTfx2015RestructuringProgramsRelatedwhat portion of the total 2015 restructuring programs is related to termination benefits?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 243 OUT582
✓
FinQaTmus2017SizeSquareFeetwhat is the average size ( in square feet ) of call centers in 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 069 OUT250
✓
FinQaUps2016Buildingswhat was the change in millions of buildings from 2015 to 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 079 OUT243
✓
FinQaV2008SupportIncentivesExpectedwhat portion of the total support incentives is expected to be paid in 2009?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 925 OUT517
Reasoning - FinQA annual report calculations (set 11) 32 passed1 failed
97.0%
 IN70 234 OUT16 924
✓
FinQaAdbe2008YearlyAmortizationPurchasedwhat is the yearly amortization rate for the purchased technology?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 960 OUT328
✓
FinQaAes2001HighLowStockwhat was average of high and low stock prices for the first quarter of 2000?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 796 OUT260
✓
FinQaAmat2013ReturnInvestedAppliedwhat is the gain if $ 100000 is invested in applied materials in 2008 and sold in 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 063 OUT406
✓
FinQaBll2006HardAssetsNetproperty , plant and equipment is what percent of net assets acquired for the u.s . can and alcan acquisitions combined?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 036 OUT428
✓
FinQaBll2010CashFlowsProvidedwhat was the percentage change in cash flows provided by ( used in ) operating activities including discontinued operations between 2009 and 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 170 OUT399
✓
FinQaC2009ContractualObligationsLongin 2010 what was the percent of the contractual obligations by year long-term debt obligations to the total1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 168 OUT305
✓
FinQaCdns2015CumulativeStockholderReturnwhat was the difference in percentage cumulative 5-year total stockholder return for cadence design systems inc . and the nasdaq copmosite for the period ended 1/3/2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN1 837 OUT407
✓
FinQaCe2009CurrencyMaturitiesWouldfor the 2010 currency maturities , what would the value be without the euro maturities , in us$ millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 184 OUT461
✓
FinQaDish2011CurrentBlockbusterPointwhat is the current ratio of blockbuster at the point of acquisition?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 023 OUT301
✓
FinQaDvn2012DebtMaturedwhat percentage of debt matured between 2016 and 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 915 OUT302
✓
FinQaEcl2017AssetsAcquiredAnioswhat portion of total assets acquired of anios are intangible assets?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 987 OUT367
✓
FinQaEcl2017CarryingGoodwillwhat is the percentage change in the total carrying amount of goodwill from 2015 to 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 465 OUT944
✓
FinQaEcl2017StatutoryEffectiveIncome2what is the difference between the statutory u.s . rate and the effective income tax rate in 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 864 OUT934
✓
FinQaEtr2004DecreaseNetIncomewhat is the decrease in net income as a percentage of the the decrease in net revenue from 2003 to 2004?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 827 OUT557
✓
FinQaEtr2004GrowthNetRevenue2what is the growth rate in net revenue in 2004 for entergy louisiana?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 817 OUT377
✓
FinQaEtr2017AnnualLongTermwhat is the percent change in annual long-term debt maturities from 2018 to 2019?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 187 OUT363
×
FinQaFis2006LeasedLocationsLocatedwhat portion of the total leased locations are located in the united states ( count the number shown for grouped states as the number for each state listed )?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
Assertion expression evaluated to false: difference <= tolerance Context: answer: 0.7226, expected: 0.74448 Values: difference = 0.02188000000000001 tolerance = 0.0074448000000000005
 Failed IN1 913 OUT604
✓
FinQaFis2016ConsolidatedRevenuesGfswhat percent of total consolidated revenues in 2015 was the gfs segment?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 996 OUT274
✓
FinQaGis2018NoncancelableFutureLease2what was the percent of the total noncancelable future lease commitments for operating leases that was due in 20201 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 039 OUT427
✓
FinQaGpn2013FairGrantedShareswhat is the total fair value of the granted shares in 2013 , ( in thousands ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 104 OUT373
✓
FinQaGs2013MinimumCollateralPostedin millions for 2013 and 2012 , what was the minimum collateral posted?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 175 OUT149
✓
FinQaGs2013SecuritiesCertainOvernightwhat percentage of total average securities and certain overnight cash deposits that are included in gce during 2013 were non-u.s . dollar-denominated?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 069 OUT543
✓
FinQaGs2018NetInterestIncomewhat was net interest income in the consolidated statements of earnings in billions for 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 537 OUT379
✓
FinQaGs2018NetRevenuesConsolidatedwhat is the total net revenues in the consolidated statements of earnings in 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 536 OUT537
✓
FinQaHig2011IncreaseNetAsbestoswhat is the total increase in net asbestos reserves in 2010 and 2009 combined from unfavorable development driven by the same factors experienced by the direct policyholders?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 224 OUT2 988
✓
FinQaHwm2018ConsideringExercisePrice2considering the average exercise price of options , what is the estimated total value of stock options in 2018 , in millions of dollars?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 604 OUT240
✓
FinQaJpm2005EndedDecemberMidpointfor the year ended december 31 2005 , what was the midpoint earnings exposure between a 100bp and 200bp change in interest rates ( in us$ m ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 282 OUT364
✓
FinQaJpm2010DecemberCollateralAble2as of december 31 , 2009 , what percentage of the collateral that it was able to sell , repledge , deliver , or otherwise use was actually used for these purposes?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 948 OUT543
✓
FinQaJpm2015DerivativeReceivablesReportedwhat was the change in the derivative receivables reported on the consolidated balance sheets from 2014 to 20151 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 478 OUT322
✓
FinQaLmt2014Backlogwhat was the change in millions in backlog at year-end between 2013 and 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 463 OUT270
✓
FinQaMro2004PeriodsPricePaidfor the periods 10/01/04 2013 10/31/04 and 11/01/04 2013 11/30/04 , what was the average of the average price paid per share?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 287 OUT383
✓
FinQaRsg2013ExpectedVolatilitywhat was the percentage change in the expected volatility from 2012 to 20131 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 926 OUT380
✓
FinQaSna2013IncomeTaxesPaidwhat is the difference between income taxes paid and income tax expense for 2013 , ( in millions ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 354 OUT1 009
Reasoning - FinQA annual report calculations (set 12) 32 passed1 skipped
100.0%
 IN68 185 OUT16 381
✓
FinQaAmt2006NetBalanceEmployeewhat is the net change in the balance of employee separations liability during 2004?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 473 OUT345
✓
FinQaAmt2006OutstandingNotesUnderwhat was the amount outstanding under the ati 7.25% ( 7.25 % ) notes in 2006 as a percent of the amount outstanding in 2005?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 228 OUT349
✓
FinQaAmt2008WillBalanceAggregatewhat will be the balance of aggregate carrying value of long-term debt as of december 31 , 2009?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 336 OUT2 678
✓
FinQaAmt2012FinalPurchasePricebased on the final purchase price allocation what was the sum of the liabilities1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 159 OUT686
✓
FinQaAmt2012ReclassificationOciIntowhat was the total reclassification of oci into income , in millions , during the years ended december 31 , 2012 , 2011 and 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 122 OUT376
✓
FinQaAon2007NetBalanceForeignwhat is the net change in the balance of net foreign exchange translation from 2006 to 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 478 OUT243
✓
FinQaAon2007PercentualIncreaseBalancewhat is the percentual increase in the balance during the year 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 692 OUT214
✓
FinQaAos2010CumulativeReturnSmithwhat was the difference in the cumulative total return for a o smith corp and the s&p small cap 600 index for the five year period ended 12/31/10?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN1 651 OUT374
✓
FinQaAwk2018PriceShareAwkat what price per share did awk repurchase its shares of common stock in 2018?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 704 OUT541
–
FinQaC2008ManagedConsumerLoanswhat was the percentage change in total managed consumer loans from 2007 to 2008?0 AI queries 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
Skipped: Table header is garbled: the excerpt has two column groups both labelled 'end of period 2008/2007/2006' (the second group is likely average balances in the original PDF), so total managed consumer loans have two candidate values per year (e.g. 666.9 vs 618.3 for 2007); the model used each group in different runs. A human would need to ask which group is meant, and naming the figures would give the answer away.
 Skipped IN0 OUT0
✓
FinQaCdw2015MinimumForeignCurrencywhat was the minimum amount of foreign currency translation loss , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 119 OUT913
✓
FinQaDvn2018IncreaseExpensewhat is the percentage increase in total expense from 2017 to 2018?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 807 OUT296
✓
FinQaGpn2008AmortizationExpenseRelatedwhat is the average amortization expense related to customer-related intangible assets?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 848 OUT1 235
✓
FinQaGpn2013FutureMinimumLeasewhat portion of the future minimum lease payments are due in the next 12 months?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 899 OUT493
✓
FinQaHig2011NetReservesRelatedof the total net reserves , what portion is related to london market?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 209 OUT314
✓
FinQaHolx2009EstimatedFairHologicwhat is the estimated fair value per share of the hologic common stock issued in the cytyc merger?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 046 OUT1 007
✓
FinQaHolx2009EstimatedPurchasePricewhat portion of the total estimated purchase price is paid in cash?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 047 OUT303
✓
FinQaIlmn2008CompanyContributionsEmployeewhat was the change in millions of company contributions to the employee benefit plans retirement plan between 2007 and 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 110 OUT319
✓
FinQaLmt2014WeightedCommonShareswhat was the change in millions of the weighted average common shares outstanding for diluted computations from 2013 to 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 221 OUT653
✓
FinQaMas2012DecemberOutstandingSharesas of december 2012 , what was the remaining repurchase authorization as a percent of the 50 million shares originally authorized?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 965 OUT407
✓
FinQaMas2017GrowthIndexwhat was the percentage of the growth of the s&p 500 index from 2016 to 20171 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 836 OUT343
✓
FinQaMo2014RestrictedStockDeferredwhat is the restricted stock and deferred stock vested in 2014 as a percentage of net earnings attributable to altria group inc . in 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 911 OUT353
✓
FinQaMo2016AltriaOutperformPeerdid altria outperform it's peer group?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 079 OUT169
✓
FinQaMro2008PipelineBarrelsHandledwhat was total pipeline barrels handled ( thousands of barrels per day ) for the three year period?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 185 OUT194
✓
FinQaNclh2018CapitalExpenditureswhat is the anticipated percentage change in capital expenditures from 2019 to 2020?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 653 OUT524
✓
FinQaNws2017WillAmortizedEachhow much in millions will be amortized each year for the acquired technology related to the realtor.com ae website?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 022 OUT216
✓
FinQaPnc2012NonperformingLoansbetween 2011 an 2012 , what was the change in nonperforming loans in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 302 OUT210
✓
FinQaPnc2015PrincipleInterestProductsfor principle and interest products , what percent of the total was due in 2020 and thereafter?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 535 OUT388
✓
FinQaSlg2011CompensationExpenseConnectionwhat was the percent of the change in the compensation expense in connection with connection with the 2005 outperformance plan.during from 2009 to 20101 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN3 473 OUT390
✓
FinQaStt2006AssetsUnconsolidatedConduitswhat is the percentage change in total assets in unconsolidated conduits from 2005 to 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 437 OUT370
✓
FinQaTfx2015RestructuringProgramsRelated2what portion of the total 2015 restructuring programs is related to facility closer costs?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 244 OUT408
✓
FinQaUps2010ContractualObligationsCommitmentswhat percentage of contractual obligations and commitments in total are debt principal and debt interest?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 324 OUT534
✓
FinQaV2014ShareCompensationCostwhat is the total share-based compensation cost in the last three years?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 070 OUT536
Reasoning - FinQA annual report calculations (set 13) 32 passed1 failed
97.0%
 IN75 209 OUT18 916
✓
FinQaAal2013BankruptcySettlementObligations2what portion of the total bankruptcy settlement obligations are related to labor deemed claims?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 451 OUT255
✓
FinQaAal2016FullTimeEmployees2what portion of the total full-time employees of mainline operations are pilots and flight crew instructors?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 221 OUT337
✓
FinQaAmt2012VivoAcquisitionAllowedfor the vivo acquisition what portion of the allowed towers were actually purchased under the final amended purchase agreement?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN2 169 OUT444
✓
FinQaAwk2013CompanyGrossLiabilitywhat is the he company 2019s gross liability at the end of 2013 if including interest and penalties?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 096 OUT270
✓
FinQaC2008IncreaseCitigroupAllowancewhat was the percentage increase in citigroup 2019s allowance for loan losses attributable to the consumer portfolio from 2007 to 20081 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 946 OUT648
✓
FinQaCdns2015CumulativeStockholderReturn2what was the percentage cumulative 5-year total stockholder return for cadence design systems inc . for the period ended 1/3/2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 828 OUT302
✓
FinQaDg2009YearlyDepreciationLandwhat is the yearly depreciation rate for land improvements?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 854 OUT86
✓
FinQaDg2010MinimumDepreciationCanwhat is the minimum depreciation rate that can be used for furniture fixtures and equipment?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 829 OUT386
✓
FinQaDre2002GainLandSaleswhat is the percent change in gain on land sales from 2000 to 2001?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 632 OUT332
✓
FinQaDxc2018CostsServiceswhat % ( % ) of total costs were the costs of services in 2018?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 334 OUT1 355
✓
FinQaEtr2011VarianceFavorablyAffectedwhat is the total amount of variance that favorably affected net revenue in 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 874 OUT930
✓
FinQaEtr2013NuclearVolumeDecreasewhat is the nuclear volume as a percentage of the decrease in net revenue from 2011 to 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 953 OUT493
×
FinQaGpn2013NetFairBalancewhat is the net change of the total fair value balance of non-vested shares during 2013 , in thousands of dollars?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
Assertion expression evaluated to false: difference <= tolerance Context: answer: 6820000, expected: 6820 Values: difference = 6813180 tolerance = 68.2
 Failed IN2 106 OUT1 147
✓
FinQaGpn2013UnrecognizedCompensationCostwhat was the average unrecognized compensation cost related to unvested restricted stock per year?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 099 OUT275
✓
FinQaGs2015RelatingCommitmentsInvestin billions , what was the total for 2015 and 2014 relating to commitments to invest in funds managed by the firm?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 297 OUT616
✓
FinQaGs2017GreatestDerivativesin millions for 2017 and 2016 , what was the greatest amount of derivatives?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 121 OUT210
✓
FinQaGs2018MarketMakingRevenueswhat are the total market making revenues in the consolidated statements of earnings of 2017 , in billions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 540 OUT514
✓
FinQaHig2004NetIncomeCumulativewhat is the change in net income from cumulative effect of adoption?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 824 OUT413
✓
FinQaHii2015MinimumYearlyDepreciationwhat is the minimum yearly depreciation rate that can be used for land improvements?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 039 OUT1 445
✓
FinQaHii2015NetIncomeMarginwhat is the net income margin in the q3 of 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 860 OUT234
✓
FinQaHolx2006WouldCashImpactwhat would the cash impact be if all outstanding options warrants and rights were exercised?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 105 OUT392
✓
FinQaHum2009WeightedFairGrantwhat was the percent of the change of the weighted-average fair value at grant date from 2008 to 20091 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 067 OUT354
✓
FinQaJpm2008ImpactDvaBasiswhat was the average impact on dva of a 1 basis point increase in jpmorgan chase credit spread for 2008 and 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 597 OUT1 264
✓
FinQaJpm2018CibMarketsNet2in 2017 what was the percent of the cib markets net interest income as part of the managed interest income1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN3 685 OUT414
✓
FinQaMo2014HigherPricingOperatingwhat is the higher pricing as a percentage of the operating companies income increase?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 928 OUT307
✓
FinQaMro2004DecreaseDevelopmentCostswhat was the 2004 rate of decrease in development costs?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 870 OUT1 483
✓
FinQaMro2007VestingDateFairwhat was the total vesting date fair value of restricted stock awards which vested during 2007 , 2006 and 2005 in $ million?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 606 OUT653
✓
FinQaMro2017InitialHealthCare2what is the difference in the initial health care trend rate and the ultimate health care trend rate in 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 470 OUT279
✓
FinQaPnc2012HomeEquityUnresolved2for home equity unresolved asserted indemnification and repurchase claims in millions , what was average balance for december 31 2012 and december 31 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 964 OUT795
✓
FinQaSna2007PretaxLossesRelatedwhat was the percentage change in the in pretax losses related to foreign exchange transactions in 20071 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 503 OUT521
✓
FinQaStt2011ApproximateNumberWorkforcewhat is the approximate total number of workforce before the restructuring program?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 207 OUT263
✓
FinQaUaa2016Inventorieswhat was the percentage change in inventories from 2015 to 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 698 OUT430
✓
FinQaUnp2009WillOperatingIncreaseswhat will the 2010 operating ratio be if the average of the 2009 and 2008 changes occurs in 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 436 OUT1 069
Reasoning - FinQA annual report calculations (set 14) 33 passed
100.0%
 IN72 225 OUT20 332
✓
FinQaAapl2006TaxExpensewhat was the 2006 tax expense?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 025 OUT831
✓
FinQaAmat2018RoiAppliedMaterials2what is the roi for applied materials if the investment made on october 2013 was sold 5 years later?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 910 OUT400
✓
FinQaAmt2007SquareFootagePropertieswhat is the square footage of properties in massachusetts?\\n\\n1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 996 OUT234
✓
FinQaAmt2016FebruaryCompanyMarketon february 17 , 2017 , what was the company's market capitalization as reported on the nyse.\\n\\n1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 053 OUT1 420
✓
FinQaAon2018DeclineUncertainTaxin 2018 what was the percent of the decline in the uncertain tax positions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 152 OUT2 849
✓
FinQaApd2018DecreaseObservedFairwhat was the decrease observed in the total fair value of restricted stock that vested during 2017 and 2018?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 018 OUT1 456
✓
FinQaAwk2014CompanyGrossLiabilityby how much did company 2019s gross liability , excluding interest and penalties , for unrecognized tax benefits increase from 2013 to 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 253 OUT415
✓
FinQaAwk2018IntangibleAssetAmortizationwhat is total intangible asset amortization expense ( millions ) for the years ended december 31 , 2018 , 2017 and 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 722 OUT197
✓
FinQaBlk2012LowerCarryingFairwhat percent lower is the carrying value than the fair value?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 429 OUT409
✓
FinQaBll2011ContractedBacklogDecemberthe contracted backlog at december 31 , 2011 contained how much in million dollars for fixed price contracts?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 278 OUT234
✓
FinQaCb2008AmortizationExpensewhat was the average amortization expense from 2006 to 20081 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 323 OUT938
✓
FinQaCe2013GrowthDividendsReceivedwhat is the growth rate in dividends received in 2013 compare to 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 265 OUT333
✓
FinQaDisca2014CumulativeShareholderReturn2what was the percentage cumulative total shareholder return on discb common stock for the five year period ended december 31 , 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 194 OUT374
✓
FinQaEtr2008RestrictedUnitsWillwhat portion of the total restricted units will vest in 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 038 OUT394
✓
FinQaGpn2008NetAssetsAcquired3what portion of the net assets acquired is related to goodwill?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 845 OUT402
✓
FinQaGs2012MaximumNetDerivativein millions for 2012 2011 what was the maximum net derivative liabilities under bilateral agreements?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 285 OUT191
✓
FinQaGs2013MaximumNetDerivativein millions for 2013 and 2012 , what was maximum net derivative liabilities under bilateral agreements?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 178 OUT224
✓
FinQaGs2014GclaNonDollarin 2014 what percentage of gcla is in non-u.s . dollar denominated assets?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 068 OUT586
✓
FinQaGs2017LevelFinancialAssets2what was the change in level 3 financial assets from 2016 to 2017 in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 123 OUT302
✓
FinQaGs2018NetRevenuesInvestmentwhat are the net revenues in investment management in 2016 , in billions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 563 OUT289
✓
FinQaHii2015NetIncomeMargin2what is the net income margin in the q1 of 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 860 OUT295
✓
FinQaHum2017AmortizationExpenseOtherwhat was the ratio of the estimated amortization expense for other intangible assets in 2018 to 2019?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 423 OUT330
✓
FinQaIp2009ContractualObligationsFuturewhat percentage of contractual obligations for future payments under existing debt and lease commitments and purchase obligations at december 31 , 2009 due in 2011 are maturities of long-term debt?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 790 OUT338
✓
FinQaMrk2013GrowthSaleswhat is the growth rate in total sales in 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 218 OUT273
✓
FinQaMro2008PipelineBarrelsHandled2what percentage of pipeline barrels handled consisted of crude oil trunk lines in 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 185 OUT286
✓
FinQaMro2013NetUndevelopedAcreswhat percentage of net undeveloped acres expiring were located in the u.s in 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 421 OUT335
✓
FinQaMsi2008DeclineOperatingLosswhat was the percentage decline in the operating loss from 2007 to 20081 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 545 OUT1 744
✓
FinQaPnc2012ReserveLosseswhat was the average , in millions , reserve for losses in 2011 and 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 365 OUT753
✓
FinQaRcl2012IncreasePortCostswhat was the percentage increase in port costs from 2010 to 20121 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 361 OUT351
✓
FinQaSna2007SnapIncorporatedPeerin 2004 what was the ratio of the snap-on incorporated to the peer group perfomance1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 811 OUT301
✓
FinQaStt2006UnrealizedLossForeignin 2006 , what percent of the unrealized loss on available-for-sale securities did foreign currency translation offset?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 428 OUT2 146
✓
FinQaUps2010ContractualObligationsCommitments2what percentage of contractual obligations and commitments in total are pension funding?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 321 OUT267
✓
FinQaZbh2009ContractualObligationsMade2what percentage of total contractual obligations is made up long-term debt?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 779 OUT435
Reasoning - FinQA annual report calculations (set 15) 32 passed1 failed
97.0%
 IN71 211 OUT23 837
✓
FinQaAbmd2012AbiomedOutperformNasdaq2did abiomed outperform the nasdaq composite index?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 747 OUT256
✓
FinQaAmt2003FollowingConsolidationBusinessin 2004 following the consolidation of the business operation what was the percentage of rental square feet in boston up for re-lease1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 977 OUT407
✓
FinQaAmt2003RedemptionNotesAccruedwhat fraction of the total redemption amount of the 6.25% ( 6.25 % ) notes was accrued interest?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 589 OUT591
✓
FinQaAmt2006AtiNotesPaidwhat portion of the ati 7.25% ( 7.25 % ) notes was paid off during 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 215 OUT443
✓
FinQaAmt2008OutstandingDebtUnderwhat is the percentage change in the the outstanding debt under the 3.00% ( 3.00 % ) notes from 2007 to 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 350 OUT370
✓
FinQaAmt2012SpentStockRepurchaseswas was the total amount spent on stock repurchases in december 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 970 OUT864
✓
FinQaAos2010CumulativeReturnSmith2what was the difference in the cumulative total return for a o smith corp and the russell 1000 index for the five year period ended 12/31/10?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN1 650 OUT716
✓
FinQaApd2016IncreaseOperatingMarginwhat is the increase in the operating margin observed in 2015 and 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 218 OUT275
✓
FinQaBll2006NetAssetsAcquiredwhat percentage of total net assets acquired were property plant and equipment?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 023 OUT305
×
FinQaC2009NetIncreaseSecuritieswhat was the ratio of the net increase in the in securities sold under agreements to repurchase to the net transfers in1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
Assertion expression evaluated to false: difference <= tolerance Context: answer: 0.7742, expected: 0.80645 Values: difference = 0.03225 tolerance = 0.0080645
 Failed IN1 937 OUT1 444
✓
FinQaD2002ContractsLongTermwhat percent of contracts for long-term purchases of capacity are due currently?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 776 OUT354
✓
FinQaDvn2018IncreaseExpense2what is the percentage increase in total expense from 2017 to 2018?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 807 OUT669
✓
FinQaEmr2017PaceIssuanceRemainat the pace of 2017 how many years of issuance remain for the restricted stock plan for non-management directors?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 592 OUT351
✓
FinQaEtr2004DeferredFuelCostwhat was the reduction in net revenue from deferred fuel cost revisions as a percentage of 2004 net revenue?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 821 OUT754
✓
FinQaGs2013Assets2what was the change in millions of total assets from 2012 to 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 165 OUT647
✓
FinQaGs2013CumulativeReturnGoldman2what was the percentage cumulative total return for goldman sachs group inc . for the five year period ending 12/31/13?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 903 OUT264
✓
FinQaGs2014GclaNonDollar2in 2013 what percentage of gcla is in non-u.s . dollar denominated assets?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 068 OUT971
✓
FinQaGs2015FutureLeasePaymentsfor future lease payments , what percent was due in 2021 and thereafter?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 284 OUT449
✓
FinQaHolx2009FairNonVested2what is the total fair value of non-vested shares as of september 27 , 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 179 OUT2 087
✓
FinQaHum2009ExpectedVolatilitywhat was the percent of the change of the expected volatility from 2008 to 20091 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 062 OUT374
✓
FinQaIlmn2003CumulativeStockholderReturnwhat was the difference in cumulative total stockholder return percentage for illumina inc . common stock versus the nasdaq pharmaceutical index for the four years end 2003?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN1 726 OUT889
✓
FinQaJpm2003DeclineCommercialPaperwhat was the decline in commercial paper issued by conduits during 2003 , in b?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 775 OUT2 331
✓
FinQaJpm2012LendingRelatedCommitmentswhat was the percentage change in lending-related commitments from 2011 to 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 302 OUT592
✓
FinQaMs2007NetAssetsAcquiredwhat percentage of net assets acquired is amortizable intangible assets?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 090 OUT395
✓
FinQaNke2009OutstandingDueNoteswhat percent of the total amount outstanding is due to notes payable due at mutually agreed-upon dates within one year of issuance or on demand?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN3 270 OUT744
✓
FinQaPkg2005PurchaseCommitmentsEnergywhat percentage of total purchase commitments for energy are currently in 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 996 OUT560
✓
FinQaPpg2006IncreaseAssetRetirementwhat was the increase in asset retirement obligations for closure of assets in the chemicals manufacturing process in 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 737 OUT765
✓
FinQaRsg2010AllowanceDoubtfulAccountsin 2008 what was the change in the allowance for doubtful accounts1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 098 OUT2 187
✓
FinQaRsg2010DecemberRestrictedCashas of december 31 , 2010 what was the ratio of the restricted cash and restricted marketable securities to the allowance for doubtful accounts1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 113 OUT341
✓
FinQaRsg2018DecemberTargetDebtbased on the december 31 2018 target what was the debt to equity ratio1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 952 OUT548
✓
FinQaSna2007RoiInvestmentMadewhat is the roi in s&p500 if the investment was made at the end of 2005 and sold at the end of 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 825 OUT827
✓
FinQaTmus2017OfficeSpaceThroughoutwhat is the ratio of the office space throughout the us to the office space for the corporate headquarters in bellevue1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 072 OUT488
✓
FinQaV2008ExpectedPaidSupportwhat amount is expected to be paid for support incentives in the next three years?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 922 OUT579
Reasoning - FinQA annual report calculations (set 16) 32 passed1 skipped
100.0%
 IN72 043 OUT17 020
✓
FinQaAal2013EffectHedgesAnticipatedby what percentage do the hedges reduce the anticipated increase in 2014 annual fuel expense from a $ 1 per barrel increase in the price of crude oil?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 544 OUT760
✓
FinQaAbmd2008MaximumJuneContingentif the approximately $ 1.8 million of contingent payments that must be made in cash were all applied to the june 2008 impella contingent payment of $ 5.6 million , what percent of that payment would be in cash?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 362 OUT340
✓
FinQaAdbe2008WeightedUsefulLife2is the weighted average useful life ( years ) for trademarks greater than customer contracts and relationships?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 966 OUT199
✓
FinQaAes2010RecourseDebtDecemberwhat percentage of recourse debt as of december 31 , 2010 matures in 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 125 OUT279
✓
FinQaAmt2005WriteOffConstructionwhat was the average write-off of construction-in-progress impairment charges from 2003 to 2005 in millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 482 OUT339
✓
FinQaAon2015SharePriceShareswhat was the compensation expense per share issued to u.s . employees under the employee share purchase plan in 2015 , in dollars?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 097 OUT465
✓
FinQaBkng2016GrowthMeasurementPricelinewhat was the percent of the growth in measurement of the the priceline group inc . from 2014 to 20151 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 558 OUT331
✓
FinQaBkr2017CashOperatingActivitieswhat is the cash from operating activities in 2017 as a percentage of cash and equivalents in 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 272 OUT510
✓
FinQaBll2010NetSalesDiscontinuedwhat was the percentage change in net sales for the discontinued operations between 2008 and 2009?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 320 OUT611
–
FinQaC2008ManagedConsumerLoans2what was the percentage change in total managed consumer loans from 2006 to 2007?0 AI queries 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
Skipped: Table header is garbled: the excerpt has two column groups both labelled 'end of period 2008/2007/2006' (the second group is likely average balances in the original PDF), so total managed consumer loans have two candidate values per year (e.g. 666.9 vs 618.3 for 2007); the model used each group in different runs. A human would need to ask which group is meant, and naming the figures would give the answer away.
 Skipped IN0 OUT0
✓
FinQaCme2010NumberSecuritiesIssuedwhat was the percent of the total number of securities to be issued upon exercise of outstanding options that was securities to be issued upon exercise of outstanding options1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 851 OUT1 840
✓
FinQaCme2017NetStateEffectivewhat is the 3 year average net state effective tax rate?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 282 OUT317
✓
FinQaDish2010MinimumLeasePaymentswhat percentage of total minimum lease payments are due after 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 861 OUT235
✓
FinQaDvn2018TaxNetEarningswhat was the tax rate on the net earnings due to the gain on the sale of our aggregate ownership interests in enlink discontinued operations1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 812 OUT228
✓
FinQaEtr2008NumberRestrictedUnitswhat is the total number of restricted units expected to vest in the upcoming years?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 038 OUT233
✓
FinQaGrmn2006DecreaseObservedOperatingwhat is the decrease observed in the operating leases with payments due to 3-5 years and payments due to more than 5 years?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 008 OUT871
✓
FinQaGs2012Assetswhat is the percentage change in total assets in 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 198 OUT454
✓
FinQaGs2014GrowthOperatingExpenseswhat is the growth rate in operating expenses in 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 603 OUT1 196
✓
FinQaHolx2003AllOutstandingOptionsif all outstanding options warrants and rights were exercised what would be the total cash inflow?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 235 OUT702
✓
FinQaIpg2008NetBalanceUnrecognizedwhat is the net change in the balance of unrecognized tax benefits during 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 231 OUT368
✓
FinQaJpm2003StructuredCommercialLoanin 2003 what was the ratio of the structured commercial loan vehicles to credit-linked note vehicles1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 775 OUT330
✓
FinQaJpm2003StructuredCommercialLoan2what was the average value of structured commercial loan vehicles issued by vies in 2002 and 2003 , in billions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 783 OUT546
✓
FinQaMktx2012OctoberDecemberHighfor the period of october 1 2011 to december 31 2011 , what was the difference between high and low share price?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 008 OUT685
✓
FinQaMo2014NpmAdjustmentItemswhat are the npm adjustment items as a percentage of the operating companies income increase?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 929 OUT349
✓
FinQaMrk2013InterestPenaltiesAssociatedwhat was the ratio of interest and penalties associated with uncertain tax positions in 2013 to 20121 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 499 OUT271
✓
FinQaMro2006LiabilityAssetRetirementby what percentage did total amount of the liability for asset retirement obligations increase from 2003 to 2005?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN3 002 OUT854
✓
FinQaMs2007NetAssetsAcquired2what percentage of the net assets acquired is goodwill?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 087 OUT361
✓
FinQaMsi2012WeightedEstimatedFairwhat is the percent change of weighted-average estimated fair value of employee stock options between 2011 and 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 484 OUT582
✓
FinQaNws2019DeferralRevenueRecognitionwhat was the difference in millions of deferral of revenue and recognition of deferred revenue for the fiscal year ended june 30 , 2019?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 952 OUT820
✓
FinQaTmus2017ApproximateSizeEachwhat is the approximate size of each data center leased in square feet1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 062 OUT888
✓
FinQaUa2011DecemberScheduledMaturitiesas of december 31 , 2011 what percent of the total scheduled maturities of long term debt is due in 20121 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 368 OUT375
✓
FinQaUnp2010QuarterEndedDecember2for the quarter ended december 312010 what was percent of the total number of shares attested to upc by employees to pay stock option exercise prices1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 906 OUT423
✓
FinQaUps2010ExpectedCashOutflowwhat percentage of total expected cash outflow to satisfy contractual obligations and commitments as of december 31 , 2010 are due in 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 343 OUT258
Reasoning - FinQA annual report calculations (set 17) 33 passed
100.0%
 IN71 477 OUT22 446
✓
FinQaAal2014ApproximateNumberActivewhat percentage of approximate number of active full-time equivalent employees are passenger service personnel ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 213 OUT410
✓
FinQaAal2014FlightAttendantsPilotswhat is the ratio of the flight attendants to pilots1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 208 OUT303
✓
FinQaAapl2005InventoryWorkingCapitalinventory was what percent of total working capital in 2005?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 232 OUT444
✓
FinQaAbmd2012RentExpenseFiscalwhat was total rent expense for fiscal years 2010 to 2012 , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 324 OUT716
✓
FinQaAon2007NetUnrecognizedTaxwhat is the net change amount of unrecognized tax benefits during 2007 , ( in millions ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 696 OUT283
✓
FinQaApd2018IncreaseObservedPaymentwhat is the increase observed in the payment of dividends during 2017 and 2018?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 791 OUT179
✓
FinQaAwk2012LiabilityReflectedOtherwhat was the combined liability reflected as other long-term liabilities in the accompanying consolidated balance sheets as of december 31 , 2012 and 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 051 OUT290
✓
FinQaBll2011NetSalesThreewhat were average net sales in millions for the three years ending in 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 272 OUT261
✓
FinQaDg2005CostOverLifowhat is the sum of the excess of current cost over lifo cost at february 3 , 2006 and january 28 , 2005 , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 316 OUT247
✓
FinQaDre2002EarningsServiceOperationswhat was the percentage change in the earnings from service operations increased from 2000 to 20011 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 633 OUT351
✓
FinQaEtr2004IncreaseOperationMaintenancewhat is the sum of the listed 2003 increases in other operation and maintenance expenses ( voluntary severance accruals and benefit costs ) as a percentage of 2003 net revenue?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 864 OUT823
✓
FinQaEtr2011ReceivablesMoneyPoolby how much did the receivables from the money pool differ from 2009 to 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 344 OUT365
✓
FinQaEtr2013GrowthNetRevenuewhat is the growth rate in net revenue for entergy wholesale commodities in 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 946 OUT778
✓
FinQaFis2012ImpactEurowhat is the percentage change in the impact of euro from 2011 to 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 636 OUT496
✓
FinQaGis2017LongTermObligationswhat portion of total long-term obligations are due in 2018?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 738 OUT295
✓
FinQaGrmn2008GrowthBalanceThroughoutwhat is the difference between the growth of the balance throughout the fiscal year , during 2007 and 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN2 282 OUT1 089
✓
FinQaGs2017DividendsDeclaredCommonwhat was the percentage change in dividends declared per common share between 2016 and 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 475 OUT359
✓
FinQaGs2017OffBalanceSheetwhat was the change in millions in off-balance-sheet exposures between 2016 and 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 332 OUT389
✓
FinQaIlmn2003DecemberNasdaqCompositeat december 292000 what was the ratio of the nasdaq composite index to the nasdaq pharmaceutical index1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 716 OUT654
✓
FinQaIpg2008IncreaseUnrecognizedTaxwhat is the percentage increase from beginning to end of 2008 in unrecognized tax benefits?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 232 OUT409
✓
FinQaJpm2014NetRevenueDue2what percentage of total net revenue was due to net interest income in 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 753 OUT432
✓
FinQaLmt2014CompanyMatchThreewhat was the average of company 401 ( k ) match total for the three years ended 2014 , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 308 OUT399
✓
FinQaMro2004EndingBalanceDiscountedwhat was the average ending balance in the discounted ending cash flow balance?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 869 OUT440
✓
FinQaMs2013DecemberCeventDrivenhow much of the december 31 , 2013 201cevent- driven 201d loans and commitments will mature in 2014 , in billions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 087 OUT439
✓
FinQaPnc2007DecemberHomeEquityat december 31 , 2007 , what percentage of the $ 14.4 billion of home equity loans ( included in 201cconsumer 201d in the table above ) had a loan-to-value ratio greater than 90%.?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 127 OUT278
✓
FinQaPnc2008AcrossThreeCategoriesfor 2008 across the three categories , what were the average mount of liabilities in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 572 OUT447
✓
FinQaRsg2010RemainingDiscountNoteswhat was the ratio of the remaining discount of the notes due in 2017 to 20161 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 454 OUT596
✓
FinQaRsg2016DecemberOutstandingAuthorizedas of december 31 , 2016 what was the percent of the outstanding authorized purchase capacity of the the october 2015 plan1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 052 OUT810
✓
FinQaSna2007RoiSnapInvestmentwhat is the roi in snap-on if the investment was made at the end of 2005 and sold at the end of 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 822 OUT410
✓
FinQaSna2018CashOutflowSharewhat is the total cash outflow for the share purchased during november 2018?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 343 OUT3 555
✓
FinQaSna2018SharesPurchasedOctoberwhat is the total value of shares purchased during the period from 09/30/18 to 10/27/18 , in dollars?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 341 OUT4 690
✓
FinQaUaa2016WorkingCapitalwhat was the percentage change in working capital from 2015 to 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 698 OUT509
✓
FinQaUps2012RoiInvestmentwhat is the roi of an investment in s&p500 from 2008 to 2009?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 750 OUT300
Reasoning - FinQA annual report calculations (set 18) 32 passed1 failed
97.0%
 IN75 339 OUT16 287
✓
FinQaAal2010DeclineRecordedInternationalwhat was the percentage decline in recorded international slot and route authorities to $ 708 million from $ 736 million as of december 31 , 2010 and 2009 , respectively .1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 008 OUT579
✓
FinQaAal2015DecemberLaborRelatedas of december 312013 what was the percent of labor-related deemed claim as part of the total reorganization items net1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 108 OUT327
×
FinQaAlxn2016ContractualMaturitiesLongwhat are the total contractual maturities of long-term debt obligations due subsequent to december 31 , 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
Assertion expression evaluated to false: difference <= tolerance Context: answer: 5095, expected: 3081 Values: difference = 2014 tolerance = 30.810000000000002
 Failed IN2 418 OUT271
✓
FinQaAmt2014AssetImpairmentChargeswas the change in asset impairment charges between 2014 and 2013 in us$ m?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 195 OUT377
✓
FinQaAmt2016TaxPenaltieswhat were the average tax penalties from 2014 to 2016 in millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 424 OUT983
✓
FinQaAon2007PercentualIncreaseObservedwhat is the percentual increase observed in the net derivative gains during 2006 and 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 477 OUT300
✓
FinQaC2009ContractualObligationsMadewhat percent of total contractual obligations in 2011 are made up of long-term debt obligations?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 166 OUT394
✓
FinQaCme2017DecreaseEffectiveTaxwhat was the decrease of the effective tax expense rate between 2015 and 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 292 OUT858
✓
FinQaCme2017FluctuationEffectiveTaxwhat was the fluctuation between the effective tax expense rate and the statutory u.s . federal tax rate in 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 296 OUT1 528
✓
FinQaDisca2011CumulativeShareholderReturn2what was the percentage cumulative total shareholder return on discb from september 18 , 2008 to december 31 , 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 910 OUT373
✓
FinQaEl2008ConsideringNetDeferredconsidering the 2008 net deferred loss , what is the percentage of amortization expenses?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 576 OUT285
✓
FinQaEtr2015AnalysisNetRevenuebased on the analysis of the change in net revenue from 2014 to 2015 what was the percent of the change1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 963 OUT490
✓
FinQaFbhs2017SalesWentInternationalwhat was the amount of sales in that went to international markets in millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 340 OUT300
✓
FinQaGs2012CollateralPostedwhat was the percentage change in collateral posted between 2011 and 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 282 OUT450
✓
FinQaGs2012NetDerivativeLiabilitieswhat was the percentage change in net derivative liabilities under bilateral agreements between 2011 and 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 286 OUT431
✓
FinQaGs2014GrowthOperatingExpenses2what is the growth rate in operating expenses in 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 603 OUT546
✓
FinQaGs2017DividendsDeclaredCommon2what was the percentage change in dividends declared per common share between 2015 and 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 475 OUT696
✓
FinQaGs2017SupplementaryLeverageExposurewhat was the change in millions in total supplementary leverage exposure between 2016 and 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 331 OUT453
✓
FinQaHolx2008PotionAcquisitionPaidwhat potion of the r2 acquisition is paid in cash?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 128 OUT603
✓
FinQaIlmn2008CompanyUncertainTaxwhat was the percent of the change in the company 2019s uncertain tax positions from 2007 to 20081 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 112 OUT478
✓
FinQaIpg2006InterestExpenseIncurredwhat is the total interest expense incurred by the senior unsecured notes that was redeemed in august 2005?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 576 OUT634
✓
FinQaJpm2012LoansRetainedwhat was the percentage change in loans retained from 2011 to 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 301 OUT296
✓
FinQaL2009ReturnInvestment2what is the return on investment for s&p500 from 2007 to 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 855 OUT714
✓
FinQaLmt2012SharesExcludedCalculationwhat was the ratio of the shares in 2012 to 2011 that were excluded in the calculation of the diluted earnings due to the anti-dilute nature1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 204 OUT320
✓
FinQaMrk2013GrowthSales2what is the growth rate in total sales in 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 218 OUT270
✓
FinQaMro2013OurCrudeOilin 2013 , was the percentage of our u.s . crude oil and condensate production that was sweet higher than 2012 ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 369 OUT245
✓
FinQaMs2013ExposureGovernmentRelatedwhat is the total exposure to government related derivatives , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 005 OUT223
✓
FinQaMsi2007GrowthConsolidatedNetwhat was the growth of consolidated net sales , in percentage , from 2005 to 20071 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN2 638 OUT1 177
✓
FinQaPpg2012CumulativeThreeDividendswhat are cumulative three year dividends in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN3 030 OUT294
✓
FinQaSlg2001FairInterestCollarwas the fair value of the interest rate collar greater than the fair value of the interest rate swap?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 645 OUT254
✓
FinQaSna2007BalanceMinorityInterestswhat is the percentage change in the balance of the minority interests in consolidated subsidiaries from 2006 to 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 509 OUT345
✓
FinQaUps2012CumulativeReturnInvestmentwhat was the percentage total cumulative return on investment for united parcel service inc . for the five years ended 12/31/2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 756 OUT286
✓
FinQaZbh2008ContractualObligationsDue3what percent of total contractual obligations is due 2012 or after?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 843 OUT507
Reasoning - FinQA annual report calculations (set 19) 33 passed
100.0%
 IN73 787 OUT15 381
✓
FinQaAal2014ApproximateNumberActive2what percentage of approximate number of active full-time equivalent employees consist of u.s airways employees?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 216 OUT385
✓
FinQaAdbe1999AccrualBalanceRelatedwhat portion of the 1999 accrual balance related to restructurings is comprised of canceled contracts?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 009 OUT774
✓
FinQaAes2001ScheduledMaturitiesDebt2what percentage of scheduled maturities of total debt at december 31 , 2001 are due in 2005?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 248 OUT364
✓
FinQaAmt2003BostonPropertyWillwhat portion of the boston property will be offered for sub-lease?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 963 OUT332
✓
FinQaAwk2012UnrecognizedTaxBenefitswhat was total change in unrecognized tax benefits from january 1 2011 to december 31 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 044 OUT342
✓
FinQaBkng2016PricelineGroupIndexwhat was the difference in percentage change in priceline group and the s&p 500 index for the five year period ended 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN1 561 OUT511
✓
FinQaBlk2014CommitmentsDueAfterwhat percent of the commitments are due after 2019?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 869 OUT212
✓
FinQaBll2010WithoutChargeSecuritizationwithout the charge for the a/r securitization , what would cash flows provided by operating activities for all operations in 2010 have been ( in millions ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 173 OUT326
✓
FinQaC2008ConsumerBankingGainwhat was the percentage of the consumer banking gain as part of the 2007 pretax total gain1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 373 OUT232
✓
FinQaC2008TaxAppliedCompanywhat was the tax rate applied to the company recorded sales of the mastercard shares in 2007 , the company recorded a $ 367 million after-tax gain ( $ 581 million pretax )1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 397 OUT314
✓
FinQaC2009ContractualObligationsMade2what percent of total contractual obligations in 2010 are made up of long-term debt obligations?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 166 OUT307
✓
FinQaC2018PrincipalTransactionsRevenue2what was the percent change of the principal transactions revenue associated with interest rate risks from 2016 to 20171 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 790 OUT579
✓
FinQaCb2008NetIncomeCapitalwhat is the net income-to-capital ratio for bermuda subsidiaries in 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 323 OUT357
✓
FinQaCdns2015ReturnNasdaqInvestmentwhat is the rate of return in nasdaq of an investment from 2010 to 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 830 OUT319
✓
FinQaCe2013GrowthDividendsReceived2what is the growth rate in dividends received in 2012 compare to 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 265 OUT448
✓
FinQaDre2008ImprovementUnbilledReceivableswhat was the percentage improvement in the unbilled receivables on construction contracts from 2007 to 20081 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 329 OUT400
✓
FinQaFis2016GrowthGfsSegmentwhat is the growth rate for the gfs segment in 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 995 OUT266
✓
FinQaGpn2010NonVestedMayin 2009 what was the percentage change in the non-vested at may 31 20091 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 168 OUT439
✓
FinQaGs2013NetDerivativeLiabilitieswhat was the percentage change in net derivative liabilities under bilateral agreements from 2012 to 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 178 OUT312
✓
FinQaGs2013SecuritiesCertainOvernight2what percentage of total average securities and certain overnight cash deposits that are included in gce during 2012 were non-u.s . dollar-denominated?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 069 OUT425
✓
FinQaGs2013ShareholdersEquitywhat was the change in millions of total shareholders' equity from 2012 to 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 167 OUT389
✓
FinQaHig2004EffectReclassifyingCertainwhat is the total effect of reclassifying certain separate accounts to general account on the net income and other comprehensive income?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 835 OUT1 147
✓
FinQaHolx2007IntangibleAssetTakenwhat is the total value of intangible assets , including goodwill , taken into account when setting up the estimated purchase price?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 975 OUT1 202
✓
FinQaIntc2015SquareFootOwned2what is the percent of the square foot in millions of owned facilities in the other countries to the of the total owned facilities1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 001 OUT500
✓
FinQaJpm2018LightNetInterestin light of the net interest yield on average interest-earning assets ( managed basis ) , what is the total value of the average assets in 2018 , in millions of dollars?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN3 700 OUT926
✓
FinQaMktx2012LowMktxStockby how much did the low of mktx stock increase from the fourth quarter of 2011 to the first quarter of 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 005 OUT332
✓
FinQaMsi2014NumberSharesPurchasedwhat is the percent change in number of shares purchased by employees between 2013 and 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 695 OUT398
✓
FinQaPnc2012CommercialMortgageLoans3commercial mortgage loans held for sale designated at fair value at december 31 , 2012 were what percent of total loans held for sale?,1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 528 OUT402
✓
FinQaPnc2012TwoSpecificReserveswhat was the two-year total for specific reserves in the alll , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 294 OUT247
✓
FinQaPpg2008DecemberUnrecognizedTaxas of december 31 , 2008 , what percentage of unrecognized tax benefits would not impact the effective if recognized?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 430 OUT361
✓
FinQaRsg2012AdditionsChargedExpensewhat was the percentage change in the additions charged to expense from 2011 to 2012 as part of the allowance for doubtful accounts1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 043 OUT285
✓
FinQaTmus2017SizeSquareFeet2what is the average size ( in square feet ) of switching centers in 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 069 OUT376
✓
FinQaUps2016Vehicleswhat was the change in millions of vehicles from 2015 to 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 079 OUT1 172
Reasoning - FinQA annual report calculations (set 2) 32 passed1 failed
97.0%
 IN73 029 OUT21 026
✓
FinQaAbmd2005CompensationExpenseRelateddid compensation expense related to the company 2019s employee stock purchase plan grow from 2004 to 2005?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 214 OUT337
✓
FinQaAbmd2008AssumingSameLevelassuming the same level of reductions for closing of the applicable statute of limitations as in fiscal 2008 , what would be the ending balance at march 31 2009 , in thousands , for unrecognized tax benefits?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 358 OUT428
✓
FinQaAes2010AnnualInterestCostwhat is the annual interest cost savings by the company redeeming the 8.75% ( 8.75 % ) second priority senior secured notes?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 133 OUT216
✓
FinQaAon2007NetAonUnpaidwhat is the net change in aon 2019s unpaid restructuring liabilities during 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 537 OUT469
✓
FinQaBll2010DecreaseCashFlowswhat was the percentage decrease in cash flows from operations from 2009 to 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 161 OUT2 394
✓
FinQaCme2010AssumingAllOptionsassuming all options in the compensation plans approved by security holders were exercised , what would be the deemed proceeds to the company?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 846 OUT312
✓
FinQaEtfc2007DecemberSquareFootage2as of december 2007 what was the percent of the square footage in alpharetta georgia not yet leased1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 302 OUT298
✓
FinQaEtfc2011DecemberCollateralPledgedas of december 31 , 2010 , what was the ratio of collateral pledged to the bank by its derivatives counterparties to overnight and other short-term borrowings1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 538 OUT357
✓
FinQaEtfc2012DecemberSquareFootageas of december 2012 what is the percent of the square footage not leased to the total square footage in alpharetta , georgia1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 954 OUT370
✓
FinQaEtr2004GrowthNetRevenuewhat is the growth rate in net revenue for entergy mississippi , inc . in 2003?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 865 OUT287
✓
FinQaEtr2013NetRevenueEntergywhat is the net change in net revenue for entergy wholesale commodities during 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 946 OUT637
✓
FinQaEtr2013NuclearRealizedPricewhat are the nuclear realized price changes as a percentage of the decrease in net revenue from 2011 to 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 955 OUT542
✓
FinQaFbhs2017DecemberGrantedShareas of december 31 , 2017 what was the value of the granted share awards1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 157 OUT1 184
✓
FinQaFbhs2017WeightedFairDatewhat was the percentage change in the weighted average fair value on the date of the award of the common stock1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 157 OUT1 154
✓
FinQaFis2012ImpactEuroEarningswhat was the percentage change in the impact of the euro on earnings from 2010 to 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 639 OUT248
✓
FinQaFis2016CashFlowsOperationswhat was the percentage change in cash flows from operations from 2014 to 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 362 OUT495
✓
FinQaFis2017RevenueGeneratedNonwhat is the percentage change in revenue generated from non-us currencies from 2015 to 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 128 OUT440
✓
FinQaGis2017FutureEstimatedCashin 2017 what was the percent of the total future estimated cash payments under existing contractual obligations associated with long-term debt that was due in 20181 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 757 OUT311
✓
FinQaGpn2014SecuritiesIssuedApprovedwhat is the total value of securities issued and approved by security holders , ( in millions ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 871 OUT832
✓
FinQaGs2013CumulativeReturnGoldmanwhat was the difference in percentage cumulative total return for goldman sachs group inc . and the s&p 500 index for the five year period ending 12/31/13?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN1 914 OUT612
✓
FinQaGs2017StockOptionsCancelledwhat is the total amount of stock options cancelled in millions during 2017 , 2016 and 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 481 OUT1 486
✓
FinQaHig2004AdoptionProspectiveMethodin the adoption of the prospective method what was the ratio of the other comprehensive income to the net income reclassifying certain separate accounts to general account1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 840 OUT269
✓
FinQaHolx2007EstimatedPurchasePricewhat portion of the estimated purchase price is derived by the net tangible assets?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 970 OUT359
✓
FinQaK2006CashFlowwhat was the average cash flow from 2004 to 20061 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 611 OUT390
✓
FinQaMktx2004SharesCommonStockin 2004 and 2003 , what were the total shares of common stock that were issued to employees?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 203 OUT278
✓
FinQaNws2017IntangibleAssetsRelatedwhat percentage of the intangible assets is related to the license of the realtor.com ae trademark?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 019 OUT408
✓
FinQaPnc2012AmortizedAssetsMadein 2012 what was the percent of the total amortized assets that was made of total securities available for sale1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 455 OUT1 748
✓
FinQaPnc2012CarryingInvestmentSecuritieswhat percentage of the total carrying amount of investment securities is the securities held to maturity?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 447 OUT351
✓
FinQaPnc2012CommercialMortgageLoans2commercial mortgage loans held for sale designated at fair value at december 31 , 2011 were what percent of total loans held for sale at december 31 , 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 539 OUT334
✓
FinQaSna2018QuarterEndedSharesfor the quarter ended 12/29/2018 what was the percent of the total shares bought after 11/25/20181 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 360 OUT354
✓
FinQaStt2009SharesPurchasableUnderwhat is the total value , in dollars , of the shares purchasable under the warrant?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 449 OUT241
×
FinQaUa2007NovemberStockIssuein november 2005 what was the percent of the stock issue costs to the company proceeds1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
Assertion expression evaluated to false: difference <= tolerance Context: answer: 0.08745, expected: 0.09583 Values: difference = 0.008379999999999999 tolerance = 0.0009583
 Failed IN2 021 OUT2 143
✓
FinQaZbh2008ContractualObligationsCategorizedwhat percent of total contractual obligations is categorized as long term debt?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 840 OUT742
Reasoning - FinQA annual report calculations (set 20) 33 passed
100.0%
 IN73 569 OUT16 822
✓
FinQaAal2013AagSeriesPreferredwhat is the ratio of the aag series a preferred stock to single-dip equity obligations1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 454 OUT387
✓
FinQaAal2013AmericansLaborRelatedwhat is the percent of americans labor-related deemed claim as a part of the total claims and other bankruptcy settlement obligations as of december20131 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 466 OUT365
✓
FinQaAapl2006OppenheimerRsusVestif mr . oppenheimer's rsus vest , how many total shares would he then have?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 297 OUT269
✓
FinQaAapl2006TaxExpense2what was the 2005 tax expense?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 025 OUT918
✓
FinQaAdbe2008YearlyAmortizationTrademarkswhat is the yearly amortization rate for the trademarks?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 959 OUT235
✓
FinQaAes2001FirstQuarterHighwhat was the 2001 first quarter average of high and low stock prices?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 794 OUT268
✓
FinQaAes2002RentalExpenseThroughwhat was the average sale/leaseback rental expense in millions for 2000 through 2002?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 035 OUT316
✓
FinQaAmt2007GrowthPriceShareswhat is the growth rate in the price of shares purchased by employees from 2006 to 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 688 OUT514
✓
FinQaAmt2007WeightedFairEsppwhat was the percentage change in the weighted average fair value for the espp shares purchased from 2005 to 20071 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 691 OUT546
✓
FinQaAmt2008DecemberMaturitiesAggregateas of december 31 , 2008 , what was the percent of the maturities in 2012 of the aggregate carrying value of long-term debt , including capital leases1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 350 OUT1 137
✓
FinQaAmt2016NumberSharesRegisteredwhat is the average number of shares per registered holder as of february 17 , 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 045 OUT684
✓
FinQaAon2007NetUnrealizedInvestmentwhat are the average net unrealized investment gains for the period?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 465 OUT867
✓
FinQaCmcsa2015UnrecognizedTaxBenefits2what was the change in unrecognized tax benefits from the end of 2013 to the end of 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 287 OUT657
✓
FinQaD2002EstimatedPaymentsUnderestimated payments under natural gas pipeline and storage capacity commitments for the next three years total how much , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 784 OUT737
✓
FinQaDish2011WorkingCapitalBlockbusterwhat is the working capital of blockbuster at the point of acquisition?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 023 OUT522
✓
FinQaEtfc2011DecemberLoansMaturityas of december 312011 what was the ratio of the loans with a maturity in 2037 to the loans with a maturity in 20331 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 540 OUT401
✓
FinQaEtfc2012Otti2what was the percentage change in otti between 2011 and 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 977 OUT875
✓
FinQaEtr2004MoneyPoolActivity2what is the money pool activity use of operating cash flows as a percentage of receivables from the money pool in 2003?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 160 OUT740
✓
FinQaFis2016GrowthIfsSegmentwhat is the growth rate for the ifs segment in 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 994 OUT259
✓
FinQaGis2019NetSaleswhat was the percent of the change in the net sales from 2017 to 20181 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 159 OUT560
✓
FinQaIpg2017ContingentAcquisitionPaymentswhat portion of the total contingent acquisition payments is related to deferred acquisition payments?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 220 OUT315
✓
FinQaLmt2014EstimatedFutureBenefitin 2014 what was the ratio of the estimated future benefit payments due in 2015 compared to the amount after 20201 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 326 OUT705
✓
FinQaLmt2015DilutedEarningsCommonwhat was the percentage change in diluted earnings per common share from continuing operations from 2014 to 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 333 OUT525
✓
FinQaMmm2013CompanyContributionPensionwhat was the ratio of the company contribution in 2011 to the amount in 2013 to the us pension contributions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 713 OUT915
✓
FinQaMro2003AsphaltSalesThreewhat was the sum of asphalt sales volumes , in thousands of barrels per day , for the three year period?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 171 OUT188
✓
FinQaMsi2008OperatingEarningsSegmentin 2006 what was the percent of the operating earnings to the segment net sales1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 543 OUT406
✓
FinQaMsi2012SharePriceApplicablein 2011 what was the average share price applicable to the employee purchases of 2.2 millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 479 OUT510
✓
FinQaPnc2015InterestOnlyProductsfor interest only products , what percent of the total was due in 2020 and thereafter?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 534 OUT322
✓
FinQaRsg2013GrowthWeightedEstimatedwhat was the growth of the weighted-average estimated fair values of stock options granted from 2012 to 20131 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 932 OUT372
✓
FinQaRsg2016WeightedCostSharewhat was the percent of the change in the weighted average cost per share from 2015 to 20161 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 045 OUT338
✓
FinQaUnp2009CostCapitalLeasewhat is the total cost in millions of capital lease obligation , principal only?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 311 OUT395
✓
FinQaVno2014FiveIndexwhat was the five year change in the s&p 500 index?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 597 OUT231
✓
FinQaVrtx2006GrossPropertyEquipmentwhat percent of the gross total property and equipment values in 2006 are related to computers?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 172 OUT343
Reasoning - FinQA annual report calculations (set 21) 32 passed1 failed
97.0%
 IN71 875 OUT18 232
✓
FinQaAbmd2006OperatingLeaseCommitmentsoperating lease commitments are what percent of total payment commitments?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 192 OUT373
✓
FinQaAes2010RecourseDebtDecember2what percentage of recourse debt as of december 31 , 2010 matures after 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 125 OUT375
✓
FinQaAnss2012EndedDecemberRevenuefor the year ended december 312012 what was the percent of the revenue by geographic area that was from the united states1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 435 OUT379
✓
FinQaAon2018ConsideringLiabilityUncertainconsidering the years 2016-2018 , what is the average liability for uncertain tax positions , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 167 OUT767
✓
FinQaBll2010NetSalesDiscontinued2what was the percentage change in net sales for the discontinued operations between 2009 and 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 320 OUT332
✓
FinQaC2009TaxAppliedGoodwillwhat was the tax rate applied applied to the goodwill impairment charge in the fourth quarter of 20081 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 053 OUT295
✓
FinQaC2015NetOutflowsDecwhat was the difference in billions in net outflows from dec . 31 , 2014 to dec . 31 , 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 393 OUT227
✓
FinQaC2018PrincipalTransactionsRevenue3what percentage of total principal transactions revenue in 2016 was do to interest rate risks?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 783 OUT298
✓
FinQaCme2010ApprovedEquityCompensationwhat is the total value of the approved equity compensation plans in 2005 , in millions of dollars?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 845 OUT1 178
✓
FinQaDvn2014IncreaseOccurredOctwhat percentage increase occurred from oct 24 , 2017 to oct 24 , 2018 of senior credit facility maturity?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 148 OUT357
✓
FinQaEcl2017AniosPurchasingPricewhat portion of anios' purchasing price is related to goodwill?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 986 OUT266
✓
FinQaEmr2017GrantDateFairat the average grant date fair value per share what is the value in thousands of the shares outstanding but not yet earned under incentive shares at the end of the year ? \\n1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 602 OUT310
✓
FinQaEtr2003EntergyEmployeesRepresentedwhat portion of the total entergy employees is represented by unions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 625 OUT524
×
FinQaFis2012UnfavorableImpactOperatingby how much were operating expenses reduced in 2012 as a result of the stronger u.s . dollar , based on the foreign currency impact on revenue and operating income , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
Assertion expression evaluated to false: difference <= tolerance Context: answer: 9.000, expected: 91.8 Values: difference = 82.8 tolerance = 0.918
 Failed IN1 637 OUT2 734
✓
FinQaGis2017AnticipatedBenefitsPaymentsin 2018 what was the ratio of anticipated benefits payments from our unfunded postemployment benefit plans to the deferred compensation1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 748 OUT327
✓
FinQaGis2018IssuedGuaranteesComfortwhat is the total value of issued guarantees and comfort letters for consolidated subsidiaries and non-consolidated affiliates , ( in millions ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 040 OUT223
✓
FinQaHum2017DeclineAmortizationExpensewhat was the percent of the decline in amortization expense for other intangible assets from 2016 to 20171 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 423 OUT1 083
✓
FinQaJpm2008ImpactDvaBasis2what was the total impact on dva of a 1 basis point increase in jpmorgan chase credit spread for 2008 and 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 597 OUT601
✓
FinQaLmt2014EstimatedFutureBenefit2what is the difference in estimated future benefit payments for retiree medical and life insurance plans between 2015 and 2016 , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 312 OUT282
✓
FinQaMas2012IncreasePerformanceIndexwhat was the percent of the increase in the performance of the s&p 500 index from 2008 to 20091 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 967 OUT508
✓
FinQaMro2003ProtectCarryingValues2by what percentage did protect carrying values of excess inventories increase from 2002 to 2003?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 193 OUT1 034
✓
FinQaMro2006LiabilityAssetRetirement2by what percentage did total amount of the liability for asset retirement obligations increase from 2004 to 2005?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN3 002 OUT469
✓
FinQaMro2011DevelopmentCostsThreewhat were total development costs in millions for the three year period?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 749 OUT200
✓
FinQaNclh2018AccredInterestLiabilitywhat is the percentage change in accred interest liability in 2018 compare to 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 219 OUT328
✓
FinQaPnc2012TwoSpecificReserves2what was the two-year total for specific reserves in the alll , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 294 OUT273
✓
FinQaPpg2018IncreaseNewJerseywhat was the percentage increase in the new jersey chrome environmental reserve in 2018?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 390 OUT266
✓
FinQaRsg2012AllowanceDoubtfulAccountswhat was the change in the allowance for doubtful accounts in 20121 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 028 OUT415
✓
FinQaStt2011AggregateRestructuringChargeswhat was the percent of the aggregate restructuring charges recorded in 20101 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 210 OUT487
✓
FinQaUnp2006BothMainLinewhat is the percent of both the main line and branch line routes that are owned by the company1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 067 OUT840
✓
FinQaUnp2009CostLocomotiveOctoberwhat was the average cost per locomotive , in millions of dollars , for the october 15 , 2009 purchase by the railroad?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 322 OUT880
✓
FinQaUps2007ExpectedCashOutflow2what percentage of the total expected cash outflow to satisfy contractual obligations and commitments as of december 31 , 2007 , is pension fundings?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 343 OUT623
✓
FinQaUps2007ExpectedCashOutflow3what portion of total expected cash outflow for capital leases is due in 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 330 OUT408
✓
FinQaUps2007ExpectedCashOutflow4what portion of total expected cash outflow for operating leases is due in 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 330 OUT570
Reasoning - FinQA annual report calculations (set 22) 33 passed
100.0%
 IN73 232 OUT19 435
✓
FinQaAal2013CostAircraftFuelwhat is the percentage change in total cost of aircraft fuel in 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 527 OUT328
✓
FinQaAal2013GrowthPriceAircraftwhat is the growth rate in the price of aircraft fuel per gallon from 2012 to 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 535 OUT363
✓
FinQaAal2013OperatingCostsin 2011 what was the total operating costs in millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 523 OUT466
✓
FinQaAal2014AmericanPersonnelAirwayswhat is the ratio of the total american personnel to us airways personnel1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 211 OUT414
✓
FinQaAapl2006LowestEffectiveTaxwhat was the lowest effective tax rate in the three year period?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 027 OUT1 227
✓
FinQaAdi2010GrowthBalanceMoneywhat is the growth rate in the balance of money market funds in 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 103 OUT278
✓
FinQaAes2002DiscontinuedOperationsRepresenttotal discontinued operations represent what percentage of total future minimum lease commitments?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 023 OUT274
✓
FinQaAmt2008NetBalanceLiability2what is the net change in the balance of liability related to employee separations during 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN3 448 OUT809
✓
FinQaAmt2012SpentStockRepurchases2was was the total amount spent on stock repurchases in the fourth quarter?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 992 OUT680
✓
FinQaAmt2016NetBalanceUnrecognizedwhat is the net change in the balance of unrecognized tax benefits during 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 423 OUT2 997
✓
FinQaBkng2016PricelineGroupFivewhat was the percentage change in priceline group for the five year period ended 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 550 OUT279
✓
FinQaBll2011GrowthNetSaleswhat is the growth rate in net sales from 2010 to 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 274 OUT274
✓
FinQaCme2010WhatsEquityCompensationwhats is the percentage of equity compensation plans that were not approved by security holders?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 838 OUT1 940
✓
FinQaDish2010MinimumLeasePayments2what percentage of total minimum lease payments are due in 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 861 OUT241
✓
FinQaDre2007BasicNetIncomewhat was the average basic net income available for common shareholders from 2005 to 20071 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 188 OUT354
✓
FinQaEcl2017CarryingGoodwill2what is the percentage change in the total carrying amount of goodwill from 2016 to 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 465 OUT406
✓
FinQaEtr2004DecreaseGrossWholesalewhat is the decrease in gross wholesale revenue as a percentage of 2003 net revenue?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 862 OUT675
✓
FinQaEtr2008IssuableLongTermwhat is the total value , in millions of dollars , of tax-exempt bonds and other long-term securities that entergy gulf states louisiana requested authority to issue?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 152 OUT253
✓
FinQaEtr2011NetRevenuewhat is the percentage change in net revenue from 2010 to 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 875 OUT287
✓
FinQaEtr2016NetRevenueDuefor 2016 , what percentage of net revenue was due to the retail electric price adjustment?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 821 OUT279
✓
FinQaGpn2018UnvestedRestrictedStock2what was the value in thousands of unvested restricted stock and performance awards at the weighted-averagegrant-datefair value as of december 31 , 2018?\\n1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 311 OUT388
✓
FinQaJpm2010FirmPledgedAssetswhat was the percent of the firm 2019s total pledged assets in 2010 that was loans1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 932 OUT354
✓
FinQaKhc2018SharesIssuedhow many shares were issued during the period of 2016 to 2018 , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 240 OUT870
✓
FinQaLmt2012WeightedCommonShares2what is the percentage change in the weighted average common shares outstanding for basic computations from 2011 to 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 195 OUT536
✓
FinQaLmt2012WeightedCommonShares3what was the percent of the change in weighted average common shares outstanding for diluted computations from 2011 to 20121 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 195 OUT305
✓
FinQaMo2014EarningsBasicDilutedwhat is the percent change in earnings for basic and diluted eps from 2013 to 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 901 OUT378
✓
FinQaMrk2013ConsideringSettlementsconsidering the years 2011-2013 , what is the average value of settlements as presented in the table ( reductions shown as negative values ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 508 OUT304
✓
FinQaMro2017InitialHealthCare3what is the difference in the initial health care trend rate and the ultimate health care trend rate in 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 470 OUT908
✓
FinQaPkg2002BalanceOptionsDecemberwhat is the total value of the balance of options as of december 31 , 2002 , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 995 OUT642
✓
FinQaPkg2005PurchaseCommitmentsOvertotal purchase commitments over the next two years are what ( in thousands ) ?\\n\\n\\n1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 000 OUT128
✓
FinQaSlg2011AccountBalancein 2011 what was the percent change in the restricted stock balance from the beginning of the year to the end of the year?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN3 455 OUT526
✓
FinQaUaa2016DebtEquitywhat is the debt-to-equity ratio in 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 692 OUT962
✓
FinQaZbh2007ConsultingProfessionalFeeswhat is the percent change in consulting and professional fees from 2006 to 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 640 OUT310
Reasoning - FinQA annual report calculations (set 23) 33 passed
100.0%
 IN69 006 OUT18 170
✓
FinQaAbmd2007ExpectedVolatilityUsedwhat is the average expected volatility used in the black scholes formula?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 501 OUT796
✓
FinQaAdi2011YearlyInterestPaymentwhat is the yearly interest payment related to the $ 375 million notional amount included in the swap terms?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 424 OUT1 633
✓
FinQaAlle2015ConsideringVariationExpensesconsidering the year 2014 , what are the variation between the expenses for environmental remediation at sites and the reserves environmental matters , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 316 OUT1 424
✓
FinQaAon2018DecreaseObservedAdditionswhat is the decrease observed in the additions for tax positions of prior years , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 152 OUT1 456
✓
FinQaAwk2017MaximumBorrowingsOutstandingby what percentage did maximum borrowings outstanding increase from 2016 to 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 163 OUT326
✓
FinQaC2018PrincipalTransactionsRevenue4what was the percent of the principal transactions revenue associated with foreign exchange risks in 20171 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 783 OUT465
✓
FinQaCme2017CmeGroupInc2in 2017 what was the ratio of the the cme group inc . stock perfomamce to the s&p1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 757 OUT263
✓
FinQaDvn2015RangeGrantDatewhat is the range of the 2014 grant-date fair value?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 188 OUT783
✓
FinQaEcl2016ContractualObligationsDuewhat portion of the total contractual obligations is due in the next 12 months?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 475 OUT263
✓
FinQaEtr2003EntergyStaffEmployedwhat portion of the total entergy staff is employed at entergy operations?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 627 OUT240
✓
FinQaEtr2008AnnualInterestExpensewhat is the annual interest expense related to series first mortgage bonds due may 2018 , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 141 OUT302
✓
FinQaFis2016ConsolidatedRevenuesGfs2what percent of total consolidated revenues in 2016 was the gfs segment?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 996 OUT378
✓
FinQaFis2017RevenueGeneratedNon2what is the percentage change in revenue generated from non-us currencies from 2016 to 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 128 OUT478
✓
FinQaGpn2014SecuritiesApprovedSecuritywhat is the total value of securities approved by security holders but net yer issued , ( in millions ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 895 OUT422
✓
FinQaGs2012LargestTierCapitalin millions for 2012 and 2011 , what was the largest tier 1 capital amount?\\n1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 489 OUT166
✓
FinQaGs2014OtherLiabilitiesAccruedwhat percentage of total other liabilities and accrued expenses in 2014 are due to compensation and benefits?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 198 OUT433
✓
FinQaGs2017CapitalFrameworkMinimumfor the capital framework , what percent of the minimum supplementary leverage ratio consisted of a buffer?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 325 OUT588
✓
FinQaHii2015OperatingMarginQuarterwhat was the operating margin in the 4th quarter1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 854 OUT707
✓
FinQaHolx2006EstimatedPurchasePrice2what percentage of the estimated purchase price is developed technology and know how?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 077 OUT396
✓
FinQaIlmn2003CumulativeStockholderReturn2what was the cumulative total stockholder return percentage for illumina inc . common stock for the four years end 2003?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 718 OUT353
✓
FinQaIlmn2008GrowthCompanyMadewhat was the percent of the growth in the company made matching contributions from 2007 to 20081 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 106 OUT399
✓
FinQaIntc2013FiveCumulativeReturnwhat was the percentage five-year cumulative return for intel for the five years ended 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 643 OUT1 104
✓
FinQaIntc2013FiveCumulativeReturn2what was the difference in percentage five-year cumulative return for intel versus the s&p 500 index for the five years ended 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN1 654 OUT420
✓
FinQaJkhy2017ReturnPeerGroupwhat was the change in the peer group cumulative total return index value from 2014 to 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 772 OUT203
✓
FinQaJpm2009Equitywhat were total average trading assets less total average trading liabilities in 2009 , in millions of dollars?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 805 OUT342
✓
FinQaJpm2015NetRevenueInterestwhat percentage of total net revenue in 2014 was net interest income?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 752 OUT247
✓
FinQaMas2012CumulativeReturnMascowhat was the percentage cumulative return of masco for the five year period ending 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 957 OUT325
✓
FinQaMmm2007InterestExpenseIncomein 2007 what was the ratio of the interest expense to the interest income1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 373 OUT584
✓
FinQaMro2013NetUndevelopedAcres2by how much did net undeveloped acres expiring decrease from 2015 to 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 423 OUT1 086
✓
FinQaSna2013FiveStockPerformancein the five-year stock performance graph what was the ratio of the of the snap-on incorporated to the peer group performance in december 31 20121 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 813 OUT449
✓
FinQaStt2011AggregateRestructuringCostswhat was the percent of the aggregate restructuring costs that were employee-related costs in 20101 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 214 OUT283
✓
FinQaUnp2006DecemberRouteMilesas of december 31 , 2006 what was the percent of the total route miles covered by the main line1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 077 OUT444
✓
FinQaUnp2016OurNetworkRoutewhat is the percent of our network route miles that is owned rather than operated on pursuant to trackage rights or leases1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 210 OUT412
Reasoning - FinQA annual report calculations (set 24) 32 passed1 failed
97.0%
 IN73 410 OUT28 150
✓
FinQaAmt2005ImpairmentChargesNet2what is the percentage change in impairment charges and net losses from 2004 to 2005?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 480 OUT2 015
✓
FinQaAon2007NetAonUnpaid2what is the net change in aon 2019s unpaid restructuring liabilities during 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 537 OUT310
×
FinQaAwk2017GrowthBorrowingsOutstandingwhat was the percent growth of borrowings outstanding from 2016 to 20171 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
Assertion expression evaluated to false: difference <= tolerance Context: answer: -0.08353, expected: 0.11713 Values: difference = 0.20066 tolerance = 0.0011713
 Failed IN2 162 OUT227
✓
FinQaBlk2012EquityComponentChangeswhat is the percent change in equity component changes from 12/31/2011 to 12/31/2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 492 OUT538
✓
FinQaBlk2015RentExpenseCertainwhat is the value of rent expense and certain office equipment expense under lease agreements , between 2013 and 2015 ? in million $ .1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 763 OUT1 219
✓
FinQaBll2011GrowthNetSales2what is the growth rate in net sales from 2009 to 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 274 OUT284
✓
FinQaCdw2015MoreMoneyExpensedhow much more money was expensed per outstanding basic weighted-average share in the year ended dec 31 , 2013 compared to the year ended dec 31 , 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 281 OUT1 420
✓
FinQaCe2016NetSpentResearch2what is the net change in the amount spent for research and development in 2015 compare to 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 154 OUT932
✓
FinQaCmcsa2008ScalableInfrastructureRepresents2scalable infrastructure represents what percent of capital expenditures incurred the cable segment during 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 296 OUT385
✓
FinQaDg2005ExcessCurrentCostwhat was the percentage change in the excess of current cost over lifo cost was approximately between 2006 and 2005 .1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 305 OUT486
✓
FinQaDisca2011SeriesStockOutperformdid the b series stock outperform the a series based on 5 year total return?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 894 OUT391
✓
FinQaDish2011HardAssetsBlockbusterhard assets were what percent of the total blockbuster purchase price?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 012 OUT2 020
✓
FinQaDvn2014DecemberDebtMaturitiesat december 31 , 2014 what was the ratio of the debt maturities scheduled for 2015 to 20181 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 156 OUT543
✓
FinQaEtr2015NetRevenueAttributedwhat percentage of net revenue of 2015 is attributed to the growth from to retail electric price?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 956 OUT333
✓
FinQaEtr2016CostWouldPassedhow much cost would be passed on to customers , in millions , due to the retail electric price variance over the next 3 years?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 831 OUT853
✓
FinQaFis2017IncreaseDecreaseWould2what percent of the total increase or decrease would the euro be in 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 122 OUT362
✓
FinQaGpn2010AfterTaxShare2what is the percentage change in the after-tax share-based compensation cost from 2009 to 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN2 184 OUT1 004
✓
FinQaGs2014Assetswhat is the percentage in total assets in 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 460 OUT1 071
✓
FinQaHii2015SalesDecemberwhat was the total sales as of december 312014 in millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 860 OUT300
✓
FinQaIpg2008BalanceUnrecognizedTaxwhat percentage of balance of unrecognized tax benefits at the end of 2008 would impact the effective tax rate if recognized?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 238 OUT406
✓
FinQaJpm2014WholesaleCreditRelatedwhat was the percentage change in total wholesale credit-related assets from 2013 to 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 474 OUT546
✓
FinQaLmt2015NetProfitMarginin 2015 what was the net profit margin1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 318 OUT2 386
✓
FinQaLmt2016NetSalesMfcwhat were average net sales for mfc in millions between 2014 and 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 447 OUT392
✓
FinQaMro2004SharesRepurchasePeriodshow many total shares were repurchase in the periods 11/01/04 2013 11/30/04 and \\n12/01/04 2013 12/31/04?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 283 OUT218
✓
FinQaMs2013CompanyHaveMoredid the company have more exposure to the insurance industry than the real estate industry in its derivative portfolio?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 012 OUT158
✓
FinQaMsi2007NetSalesSegmentin 2006 , what was the net sales to the segment 2019s top five customers in millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 640 OUT5 959
✓
FinQaNws2019NonCashAssetswhat was the value in millions of non cash assets for the transaction in which opcity was acquired?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 950 OUT209
✓
FinQaPnc2008NationalCitySponsoredfor national city-sponsored securitization qspes at december 31 , 2008 , automobile was what percent of credit card assets?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 582 OUT288
✓
FinQaPnc2012WouldAmortizedCostswhat would the amortized costs of total securities available for sale be without the $ 367 million of amortized cost of securities classified as corporate stocks as of december 31 , 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 474 OUT344
✓
FinQaRsg2009DeclineWeightedEstimatedwhat was the percentage decline in the weighted- average estimated fair values of stock options from 2007 to 20081 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 886 OUT1 453
✓
FinQaSna2013OtherAccruedLiabilitieswhat was the percent of the change in the total other accrued liabilities from 2012 to 20131 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 355 OUT409
✓
FinQaStt2009AggregateNetAssetwhat was the percent change in the aggregate net asset values of the direct lending collateral pools between 2007 and 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 906 OUT358
✓
FinQaZbh2015TaxBenefitReducewhat percent did the tax benefit reduce expenses in 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 626 OUT331
Reasoning - FinQA annual report calculations (set 25) 33 passed
100.0%
 IN75 057 OUT18 802
✓
FinQaAmt2016NetBalanceUnrecognized2what is the net change in the balance of unrecognized tax benefits during 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 423 OUT458
✓
FinQaAnss2016DecemberCompanySignificantas of december 31 , 2016 what was the percent of the company's total significant contractual obligations that was for the global headquarters operating lease?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 058 OUT425
✓
FinQaBll2006NetAssetsAcquired2what percentage of total net assets acquired were goodwill?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 020 OUT242
✓
FinQaC2015HqlaDecwhat was the difference in billions in hqla from dec . 31 , 2014 to dec . 31 , 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 393 OUT314
✓
FinQaCb2008GrowthNetIncomewhat is the growth rate in the net income of bermuda subsidiaries from 2007 to 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 330 OUT286
✓
FinQaCme2010AnnualInterestExpensewhat is the annual interest expense on the fixed rate notes due march 2018 after the hedge transaction?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 402 OUT720
✓
FinQaCme2017CmeGroupOutperformdid the cme group outperform the s&p 500 over 5 years?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 749 OUT240
✓
FinQaDisca2014AfterSeriesOutperformafter 4 years , did the series c outperform the s&p 500?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 183 OUT612
✓
FinQaDish2011TerrestarAcquisitionWillfor the terrestar acquisition what will the final cash purchase price be in millions paid upon closing?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 023 OUT279
✓
FinQaDvn2012DecemberDevonDebtas of december 31 , 2012 what was the ratio of the devon debt maturities in 2013 compared to 20141 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 932 OUT214
✓
FinQaDvn2015ContractualTermin years , what is the average contractual term for 2013 , 2014 , 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 200 OUT578
✓
FinQaDxc2018FiscalCostsExpensesin fiscal 2018 what percentage of total costs and expenses was costs of services ( excludes depreciation and amortization and restructuring costs ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 342 OUT1 360
✓
FinQaDxc2018FiscalCostsExpenses2in fiscal 2018 what percentage of total costs and expenses was selling general and administrative ( excludes depreciation and amortization and restructuring costs ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 343 OUT963
✓
FinQaEtr2004NetRevenueEntergywhat is the net change in net revenue entergy mississippi , inc . during 2003?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 864 OUT358
✓
FinQaEtr2008ReceivablesMoneyPoolwhat is the percent change in receivables from the money pool between 2007 and 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 144 OUT359
✓
FinQaGis2015MayUnrealizedLossesin may 2015 what was the ratio of the unrealized losses from interest rate cash flow hedges to the unrealized gains from foreign currency cash flow hedges1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 254 OUT666
✓
FinQaGpn2013NumberGrantsForfeitedwhat was the total number of grants were forfeited?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 093 OUT1 398
✓
FinQaGs2014CompensationBenefitsLiabilityin millions for 2014 and 2013 , what was the change in compensation and benefits liability?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 201 OUT879
✓
FinQaGs2015SecuritiesBorrowedFairwhat percentage of securities borrowed were at fair value for december 31 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 215 OUT581
✓
FinQaGs2018LowestAlternativeInvestmentsin billions for 2018 , 2017 , and 2016 , what was the lowest amount of alternative investments?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 576 OUT155
✓
FinQaHolx2007IssuedSecuritiesApprovedwhat is the total value of issued securities that are approved by security holders , ( in millions ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 131 OUT1 864
✓
FinQaIntc2013CumulativeReturnIntelin 2010 what was the ratio of the cumulative return for intel , to the the dow jones u.s . technology index*1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 651 OUT378
✓
FinQaJpm2018BasisPointsNet2by how many basis points did net interest yield on average interest-earning assets 2013 managed basis improve form 2017 to 2018?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN3 697 OUT1 046
✓
FinQaMktx2004DecemberCommonStockas of december 31 , 2004 , what percentage of common stock outstanding were non-voting shares?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 210 OUT417
✓
FinQaMro2003MapGrowthGasolinewhat was map's 3 year growth of gasoline production?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 176 OUT406
✓
FinQaMro2006FinLiabilityGreaterwas the fin 47 liability greater on december 31 2004 than december 31 2005?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN3 004 OUT297
✓
FinQaMro2013PriceWtiCrudeby what percentage did the average price of wti crude oil increase from 2011 to 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 363 OUT365
✓
FinQaPnc2012OtherLoansHeldwhat was the average for "other" loans held in 2012 and 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 520 OUT286
✓
FinQaPnc2012SpecificReservesAlllthe specific reserves in the alll as of december 31 , 2012 were what percent of the tdr portfolio?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 305 OUT487
✓
FinQaSna2013SalesPaymentsReceivedwhat was the change in trade and other accounts receivable ( before allowances ) from 2012 to 2013 , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 123 OUT849
✓
FinQaStt2011RestructuringCostComeswhat percentage of restructuring cost comes from employee-related costs?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 205 OUT308
✓
FinQaV2010PaymentVolumeTransactionwhat is the average payment volume per transaction for visa inc?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 135 OUT635
✓
FinQaZbh2009OperatingLeaseswhat was the percent change in operating leases between 2011/12 and 2013/4?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 792 OUT377
Reasoning - FinQA annual report calculations (set 26) 31 passed2 failed
93.9%
 IN72 622 OUT23 859
✓
FinQaAdbe2008NetGrossLiabilitywhat is the net change in the gross liability for unrecognized tax benefits during 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 198 OUT1 313
✓
FinQaAmt2012HardAssetsBrazilianhard assets were what percent of the brazilian purchase price , as finally determined?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 161 OUT1 784
✓
FinQaAon2010ConsiderationTransferredDedicated2what is portion of the total consideration transferred is dedicated to trademarks?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 924 OUT605
✓
FinQaAon2018IncreaseCompanyRecordedwhat was the percent of the increase in the company recorded a liability for interest and penalties from 2017 to 20181 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 163 OUT320
✓
FinQaC2018SharesGrantedwhat was the value of the shares granted1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 542 OUT979
✓
FinQaCb2010BalanceShortTermwhat is the percentage change in the balance of short-term investments in 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 009 OUT934
✓
FinQaDre2005AfterTaxGainswhat was the ratio of the after tax gains of in 2004 compared to 2003 in dollars1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 447 OUT340
✓
FinQaDre2005GainSalesBeforewhat was the total gain on sales in 2004 before any adjustment for impairments in millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 443 OUT807
✓
FinQaEtfc2012NetImpairmentwhat was the percentage change in the net impairment recognized from 2011 to 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 979 OUT797
✓
FinQaEtr2016NetRevenueEntergy2what is the net change in net revenue during 20016 for entergy mississippi , inc.?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 823 OUT365
✓
FinQaFis2016CashFlowsOperations2what was the percentage change in cash flows from operations from 2015 to 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 362 OUT366
✓
FinQaFis2016IncreaseCashFlowswhat is the percentage increase in cash flows from operations from 2015 to 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 362 OUT362
✓
FinQaGs2013DecemberFairSecuritieswhat was the average of the fair values of the securities and certain overnight cash deposits included in gce as of december 2013 and december 2012 , in billions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 077 OUT313
✓
FinQaGs2013FiveReturnIndexwhat is the five year total return on the s&p 500 index?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 889 OUT622
×
FinQaHolx2008EstimatedPriceHologicwhat is the estimated price per share , in dollars , of hologic common stock used in the r2 acquisition?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
Assertion expression evaluated to false: difference <= tolerance Context: answer: 205500, expected: 23.35227 Values: difference = 205476.64773 tolerance = 0.2335227
 Failed IN2 132 OUT675
✓
FinQaHum2017AmortizationExpensewhat was the average amortization expense between 2015 and 20171 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 414 OUT625
×
FinQaHum2017AmortizationExpenseDuewhat percent of the total estimated amortization expense for 2018 through 2022 is expected in 2019?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
Assertion expression evaluated to false: difference <= tolerance Context: answer: 0.7200, expected: 0.26341 Values: difference = 0.45659 tolerance = 0.0026341
 Failed IN1 420 OUT351
✓
FinQaIp2009ContractualObligationsFuture2what percentage of contractual obligations for future payments under existing debt and lease commitments and purchase obligations at december 31 , 2009 due in 2012 are maturities of long-term debt?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 790 OUT954
✓
FinQaJpm2005IncreaseInterestRatesfor a 2% ( 2 % ) increase in interest rates , what would have been the total impact to earnings for 2005 and 2004 ( in millions ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 279 OUT319
✓
FinQaMar2004CarryingFairNoteswhat is the difference of between the carrying amount and the fair value of notes and other long-term assets in 2004?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 813 OUT518
✓
FinQaMmm2015InternationalQualifiedNonin 2016 what was the ratio of the us to the international qualified and non-qualified pension benefits1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 185 OUT428
✓
FinQaMro2003CrackSpreadValuesfor 2002 and 2003 , what is the average crack spread values?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 189 OUT899
✓
FinQaMro2008PipelineBarrelsHandled3what percentage of pipeline barrels handled consisted of crude oil trunk lines in 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 185 OUT264
✓
FinQaMsi2008ConsolidatedNetSaleswhat percentage difference of consolidated net sales from 2006 to 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN2 544 OUT1 214
✓
FinQaMsi2012ExpectedVolatilityWeightedwhat was the average expected volatility of the weighted-average estimated fair value of employee stock options from 2010 to 20121 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 485 OUT772
✓
FinQaPkg2002BalanceOptionsJanuarywhat is the total value of the balance of options as of january 1 , 2000 , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 995 OUT267
✓
FinQaRsg2016ActualAssetAllocationbased on the 2016 actual asset allocation what was the debt to equity ratio1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 899 OUT685
✓
FinQaTfx2017NumberSecuritiesApproved2what portion of the total number of securities approved by security holders remains available for future issuance?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 619 OUT396
✓
FinQaUnp2009SatisfiedWillCustomershow satisfied will customers be in 2010 if the 2008 satisfaction index increase occurs again in 2009?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 430 OUT3 382
✓
FinQaUnp2011OperatingCashFlowfor 2011 , what percent of operating cash flow was distributed to shareholders?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 263 OUT319
✓
FinQaUps2012CumulativeReturnInvestment2what was the difference in percentage total cumulative return on investment for united parcel service inc . versus the dow jones transportation average for the five years ended 12/31/2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN1 765 OUT478
✓
FinQaWrk2018BalanceFiscalGrosswhat was the percentage change in the balance at end of fiscal year for the gross unrecognized tax benefits1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 413 OUT849
✓
FinQaWrk2018BalanceTaxBenefitsby what percent did the balance of tax benefits increase between the beginning of 2016 and the end of 2018?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 423 OUT557
Reasoning - FinQA annual report calculations (set 27) 33 passed
100.0%
 IN71 765 OUT14 772
✓
FinQaAes2002FutureMinimumLeasewhat percentage of total future minimum lease commitments is due in 2003?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 027 OUT405
✓
FinQaAlle2015ConsideringReservesEnvironmentalconsidering the year 2015 , what is the percentage of reserves for environmental matters related to remediation of sites?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 310 OUT1 120
✓
FinQaAmt2006AggregateCarryingLongwhat fraction of the aggregate carrying value of long-term debt should be reported as a current liability as of december 31 , 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 216 OUT471
✓
FinQaAwk2013NetTaxPositionswhat was the net change in tax positions for 2012 , computed as increases in current period tax positions less decreases in prior period measurement of tax positions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 083 OUT366
✓
FinQaBkng2016MeasurementPointDecemberat the measurement point december 312016 what was the ratio of the the priceline group inc . . to the nasdaqcomposite index1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 560 OUT348
✓
FinQaCdns2018NetEffectCumulative2what is the percentage net effect of the cumulative effect adjustments , net of income tax effects , on the retained earnings balance as previously reported for december 30 , 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 095 OUT994
✓
FinQaDre2012ReductionSecondGenerationwhat was the percentage reduction second generation tenant improvements1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 949 OUT340
✓
FinQaDvn2018TaxExpensewhat was the ratio in the total tax expense from 2018 to 20171 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 807 OUT234
✓
FinQaEtr2004NetRevenueEntergy2what is the net change in net revenue during 2004 for entergy louisiana?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 817 OUT309
✓
FinQaFis2016ReturnInvestedSoldwhat is the gain , in dollars , if $ 100000 is invested in the s&p 500 in 12/11 and sold in 12/16?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 700 OUT438
✓
FinQaGis2017OffBalanceSheetwhat is the total amount of guarantees and comfort letters issued as of may 28 , 2017 , ( in millions ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 751 OUT239
✓
FinQaGs2012MaximumCollateralPostedin millions for 2012 2011 , what was maximum collateral posted?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 281 OUT178
✓
FinQaGs2014OtherLiabilitiesAccrued2what percentage of total other liabilities and accrued expenses in 2013 are due to compensation and benefits?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 198 OUT313
✓
FinQaHolx2007IssuedSecuritiesApproved2what portion of the issued securities is approved by security holders?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 123 OUT806
✓
FinQaIlmn2008SharesExercisedwhat is the total exercise value , in dollars , of the outstanding warrants expiring in 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 253 OUT400
✓
FinQaIp2006ContractualObligationsFuture2what percentage of contractual obligations for future payments under existing debt and lease commitments and purchase obligations at december 31 , 2006 due in 2008 is attributable to total debt repayments?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 704 OUT313
✓
FinQaIpg2017ContingentAcquisitionPayments2what portion of the total contingent acquisition payments is due in the next 12 months?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 223 OUT418
✓
FinQaJpm2010JpmorganChaseIncomewhat was the percent of the jpmorgan chase income before income tax expense/ ( benefit ) and extraordinary gain that was us sourced1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 558 OUT398
✓
FinQaJpm2015InterestDerivativesMadeinterest rate derivatives made up how much of the net total derivatives for 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 465 OUT845
✓
FinQaJpm2015NetCashCollateralin 2007 what was the percent of the total net of cash collateral from credit derivatives1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 466 OUT262
✓
FinQaKhc2018JulyAugustDebtin july and august 2018 , what percent of the debt carrying value at december 30 , 2017 did they pay off?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 250 OUT345
✓
FinQaMar2018ContractualObligationsOffof the total contractual obligations and off-balance sheet arrangements contractual obligations what percentage is due to operating leases where we are the primary obligor?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 581 OUT573
✓
FinQaMas2017CumulativeShareholderReturnwhat was the percentage cumulative total shareholder return on masco common stock for the five year period ended 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 833 OUT437
✓
FinQaMrk2013ReconciliationUnrecognizedTaxbased on the reconciliation what was the percent of the change in the unrecognized tax benefits from 2011 to 20121 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 502 OUT571
✓
FinQaMro2013PriceWtiCrude2by what percentage did the average price of wti crude oil increase from 2011 to 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 363 OUT368
✓
FinQaRcl2016AnticipatedIncreaseGlobalwhat was the anticipated percentage increase in the global cruise fleet berths from 2017 to 20211 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 969 OUT365
✓
FinQaRsg2010SeniorNotesMarchwhat was the ratio of the 5.000% ( 5.000 % ) to 6.200% ( 6.200 % ) the senior notes in march 20101 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 479 OUT495
✓
FinQaSna2013ReturnInvestmentInvestedwhat is the return on investment if $ 100 are invested in snap-on at the end of 2008 and sold at the end of 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 818 OUT492
✓
FinQaSna2013ReturnInvestmentInvested2what is the return on investment if $ 100 are invested in s&p500 at the end of 2008 and sold at the end of 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 821 OUT367
✓
FinQaStt2014RoiInvestmentStatewhat is the roi of an investment in state street corporation from 20011 to 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 448 OUT655
✓
FinQaUnp2011PlannedCapitalExpendituresin 2012 , are the planned capital expenditures greater than free cash flow in 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 269 OUT323
✓
FinQaUnp2015NetworkRouteMileswhat is the percent of the network route in miles that is not leased but owned by the company1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 206 OUT291
✓
FinQaZbh2015ExpenseNetTax2what was the change in total expense net of tax for share based compensation from 2013 to 2014 in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 640 OUT293
Reasoning - FinQA annual report calculations (set 28) 33 passed
100.0%
 IN74 007 OUT19 569
✓
FinQaAes2001ScheduledMaturitiesDebt3what percentage of scheduled maturities of total debt are due after 5 years?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 235 OUT507
✓
FinQaAmt2003InterestRedeemedNoteswhat was the interest rate on the redeemed 6.25 notes in 20041 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 582 OUT95
✓
FinQaAmt2006NetBalanceEmployee2what is the net change in the balance of employee separations liability during 2005?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 473 OUT1 455
✓
FinQaAmt2007GrowthPriceShares2what is the growth rate in the price of shares purchased by employees from 2005 to 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 688 OUT388
✓
FinQaAmt2007PricingModelWeightedbased on the the pricing model what was the percentage change in the weighted average risk-free interest rate from 2005 to 20071 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 693 OUT566
✓
FinQaAwk2018PriceShareAwk2at what price per share did awk repurchase its shares of common stock in 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 704 OUT444
✓
FinQaBdx2018LossesDebtExtinguishmentwhat was the percentage change in the losses on debt extinguishment from 2017 to 20181 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 132 OUT613
✓
FinQaBkr2017CashHeldBehalfwhat is the cash held on behalf of ge as a percentage of cash and equivalents in 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 268 OUT603
✓
FinQaC2008PretaxGainsSalewhat was the total pretax gains in millions for the sale so mastercard shares from 2006 to 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 380 OUT492
✓
FinQaC2009NonPensionPlansin 2010 what was the ratio of the non-us pension plans , discretionary contributions to the postretirement benefit plans1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 171 OUT283
✓
FinQaCdns2018NetEffectAdoptionwhat is the net effect of the adoption of new accounting standards?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 059 OUT688
✓
FinQaCe2016ResearchDevelopmentThroughwhat is the total research and development for the year 2014 through 2016 in millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 150 OUT767
✓
FinQaEtr2016ExpectedPaymentsBonds2what is the total expected payments on the bonds for the next 5 years for entergy new orleans storm recovery funding?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN2 316 OUT532
✓
FinQaEtr2016RelatingTexasSecuritizationrelating to the texas securitization bonds , what were the total amounts ( millions ) of the issuance when considering the transaction costs and the related deferred income tax benefits?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 324 OUT2 099
✓
FinQaGrmn2008IncreaseUnrecognizedTaxwhat was the increase in the unrecognized tax benefits observed during 2007 and 2008 , in millions of dollars?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 280 OUT442
✓
FinQaGs2012FinancialLiabilitiesFairwhat is the percentage change in total financial liabilities at fair value in 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 202 OUT544
✓
FinQaIntc2015FacilitiesMeasuredSquare2what percentage of total facilities as measured in square feet are owned?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 990 OUT666
✓
FinQaJkhy2017JkhyReturnPeerjkhy's total 5 year return was what percent of the peer group?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 779 OUT568
✓
FinQaJpm2009ExcludingDerivativesNet2excluding derivatives , what are net 2008 trading assets , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 799 OUT312
✓
FinQaJpm2015WithoutForeignExchangewithout the foreign exchange hedges , what would the total net derivatives be , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 477 OUT360
✓
FinQaK2006NetCashProvidedwhat percent of net cash provided by operations is retained as cashflow in 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 613 OUT506
✓
FinQaLkq2016RentalExpenseOperating2what was the percentage change in rental expense for operating leases from 2015 to 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 893 OUT325
✓
FinQaLmt2016GrowthNetSaleswhat is the growth rate of net sales from 2015 to 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 445 OUT847
✓
FinQaMar2004CarryingFairLongwhat is the difference of between the carrying amount and the fair value of long-term debt and other long-term liabilities in 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 826 OUT1 676
✓
FinQaMro2003NaturalGasOptionsfor natural gas options in place to manage the price risk , what is the change in the percentage of the anticipated natural gas purchases hedged between the first quarter of 2004 and the second quarter of 2004?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 216 OUT739
✓
FinQaNclh2018NetInterestExpensewhat is the percentage change in net interest expense in 2018 compare to 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 219 OUT343
✓
FinQaPkg2005PurchaseCommitmentsEnergy2what percentage of total purchase commitments for energy are currently in 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 996 OUT242
✓
FinQaPnc2014TaxCreditInvestmentsfor tax credit investments included in our equity investments held by consolidated partnerships , what was the change in billions between december 31 , 2014 and december 31 , 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 283 OUT607
✓
FinQaSlb2015ShareUnderNewwhat was the percent of the share under this new share repurchase program as of december 3120151 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 376 OUT380
✓
FinQaStt2007BalanceCashGovernmentwhat is the percentage change in the the balance of cash and u.s . government securities from 2006 to 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 123 OUT382
✓
FinQaUnp2016OperatingRevenueChemicalin 2015 what was the percent of the total operating revenue that was from chemical freight1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 207 OUT371
✓
FinQaV2008SeptemberVolumeSupportin september 2008 what was the percent of the total volume and support incentives that was due in 20091 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 933 OUT342
✓
FinQaVrtx2006DepreciationAmortizationExpensewhat was the percent change in depreciation and amortization expense between 2004 and 2005?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 175 OUT385
Reasoning - FinQA annual report calculations (set 29) 32 passed1 failed
97.0%
 IN79 381 OUT14 060
✓
FinQaAapl2003ExcludingAccretionEndingexcluding accretion , what was the ending balance of asset retirement liability as of september 27 2003 , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 378 OUT322
✓
FinQaAbmd2006ObligationsOperatingLeasewhat percentage of total obligations are operating lease obligations?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 191 OUT384
✓
FinQaAbmd2008BalanceUnrecognizedTaxwhat is the percentage change in the balance of unrecognized tax benefits from 2007 to 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 335 OUT326
✓
FinQaAbmd2012IncreaseBaseRentwhat is the percentage increase in base rent for danvers , massachusetts facility from the period 2008-2010 to 2010 - 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 342 OUT370
✓
FinQaAdi2010TableWouldAnnualbased on the table , what would be the annual percent return for the companies investments?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 101 OUT258
✓
FinQaAlxn2016FacilityLeaseObligationswhat is the percentage change in total facility lease obligations from 2015 to 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 415 OUT623
✓
FinQaAnss2012RangeUnitedStateswhat is the range , in thousands , for united states' revenue from 2010-2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 432 OUT468
✓
FinQaAnss2016ProportionGlobalHeadquarterswhat is the proportion of total global headquarters leases to total other operating leases?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 040 OUT550
✓
FinQaBlk2012GrowthBalanceEquitywhat is the growth rate in the balance of equity during 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 475 OUT596
✓
FinQaBlk2012GrowthBalanceLongwhat is the growth rate in the balance of long-term debt during 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 477 OUT502
✓
FinQaBlk2014GrowthRentExpensewhat is the growth rate in rent expense and certain office equipment expense from 2013 to 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 881 OUT394
✓
FinQaBlk2014GrowthRentExpense2what is the growth rate in rent expense and certain office equipment expense from 2012 to 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 881 OUT598
✓
FinQaBll2010CashFlowsProvided2what was the percentage change in cash flows provided by ( used in ) operating activities including discontinued operations between 2008 and 2009?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 170 OUT608
✓
FinQaD2002GrowthRentalExpensewhat is the growth rate in rental expense included in other operations and maintenance expense in 2002 compare to 2001?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 791 OUT284
✓
FinQaD2002GrowthRentalExpense2what is the growth rate in rental expense included in other operations and maintenance expense in 2001 compare to 2000?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 791 OUT686
✓
FinQaGs2013CollateralPostedwhat was the percentage change in collateral posted from 2012 to 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 174 OUT353
✓
FinQaHolx2009FairGrantMoneybased on the fair value of the grant , how much money did the company lose when some of their grants were forfeited .1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 179 OUT423
✓
FinQaIp2006CapitalSpendingContinuing3in 2005 what was the percent of the total capital spending from continuing operations by each of our business segments for printing papers1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 534 OUT353
✓
FinQaIp2006IncreaseCashWorkingwhat was the difference in the increase in the cash in working capital in 2006 compared with the increase in 2005 in millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 538 OUT307
✓
FinQaIp2009DecemberFutureMinimumat december 31 , 2009 , total future minimum commitments under existing non-cancelable leases and purchase obligations what was the percent of the lease obligations compared to the purchase obligations in 20121 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 728 OUT591
×
FinQaIp2009SumTemporaryDifferenceswhat was the sum of the temporary differences between 2007 and 2009 in billions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
Assertion expression evaluated to false: difference <= tolerance Context: answer: 7.200, expected: 9.8 (either sign) Values: difference = 2.6000000000000005 tolerance = 0.098
 Failed IN2 706 OUT301
✓
FinQaJkhy2019ReturnJkhywhat was the 5 year total return for jkhy?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 032 OUT602
✓
FinQaLmt2014WeightedCommonShares2what was the change in millions of the weighted average common shares outstanding for diluted computations from 2012 to 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 221 OUT276
✓
FinQaMo2016RoiInvestmentAltriawhat is the roi of an investment in altria group inc . from december 2011 to december 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 097 OUT329
✓
FinQaNclh2018FutureCommitmentsServicewhat percentage of future commitments for service , maintenance and other business enhancement capital expenditure contracts are due in the 1-3 years period?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 658 OUT410
✓
FinQaPpg2006ReserveProductWarrantieswhat was the percentage change in the reserve for product warranties from 2005 to 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 737 OUT331
✓
FinQaPpg2018ReservesEnvironmentalContingencieswhat percent of total reserves for environmental contingencies are related to glass and chemical in 2018?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 393 OUT320
✓
FinQaPpg2018ReservesEnvironmentalContingencies2what percent of total reserves for environmental contingencies are related to new jersey chrome in 2018?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 393 OUT379
✓
FinQaUnp2011Equitywhat was the change in millions of average equity from 2010 to 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 457 OUT264
✓
FinQaUnp2015FreightRevenuesIntermodalwhat percentage of total freight revenues was the intermodal commodity group in 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 206 OUT499
✓
FinQaUnp2016OperatingRevenuesRevenuewhat percentage of total operating revenues from 2014-2016 is the revenue from coal?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN2 210 OUT669
✓
FinQaUnp2018MinimumCapitalLeaseswhat percent of total minimum capital leases payments are due in 2021?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 209 OUT434
✓
FinQaUnp2018MinimumCapitalLeases2what percent of total minimum capital leases payments are due in 2020?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 209 OUT250
Reasoning - FinQA annual report calculations (set 3) 33 passed
100.0%
 IN70 890 OUT18 181
✓
FinQaAapl2006CountingIndirectSharescounting indirect shares , how many shares would arthur d . levinson own in total?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 296 OUT317
✓
FinQaAmt2012PurchaseDecemberJanuarywhat was the ratio of the purchase in december 2012 to the purchase in january 20131 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 983 OUT370
✓
FinQaAon2010ConsiderationTransferredDedicatedwhat is portion of the total consideration transferred is dedicated to goodwill?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 924 OUT513
✓
FinQaApd2016ConsideringOperatingIncomeconsidering the years 2014-2016 , what is the average operating income?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 217 OUT697
✓
FinQaAwk2012CompanyGrossLiabilitieswhat percentage of the company's gross liabilities are classified as other long-term liabilities in the accompanying consolidated balance sheets in 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 043 OUT465
✓
FinQaAwk2013AwkUnrecognizedTaxwhat is awk's 2012 unrecognized tax benefit as a percentage of gross liabilities?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 110 OUT387
✓
FinQaBll2012FiveReturnEndingthe five year total return for the period ending 12/31/2012 on ball corporation stock was how much greater than the same return on the s&p 500?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 672 OUT739
✓
FinQaBll2012FiveReturnEnding2the five year total return for the period ending 12/31/2012 on ball corporation stock was how much greater than the same return on the dj us containers & packaging index?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 672 OUT715
✓
FinQaC2009NetInterestRevenue2what percent of net interest revenue where total operating expenses in 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 922 OUT345
✓
FinQaCb2010FairFinancialMarketwhat is the change in fair value of financial market instruments as part of the hedging strategy during 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 363 OUT960
✓
FinQaCdns2015ReturnCadenceDesignwhat is the rate of return in cadence design systems inc . of an investment from 2010 to 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 834 OUT275
✓
FinQaCdns2018NetEffectCumulativewhat is the net effect of the cumulative effect adjustments , net of income tax effects , to beginning retained earnings for new accounting standards adopted by cadence on the retained earnings balance as adjusted for december 30 , 2017 , in thousands?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 097 OUT463
✓
FinQaCme2010EstimatedRevolvingCreditwhat is the estimated percentage of revolving credit facility in relation with the total senior credit facility in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 402 OUT1 219
✓
FinQaCme2010OutstandingOptionsPlanswhat percentage of the outstanding options were from plans approved by security holders?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 836 OUT501
✓
FinQaDisca2014CumulativeShareholderReturnwhat was the percentage cumulative total shareholder return on disca common stock for the five year period ended december 31 , 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 194 OUT372
✓
FinQaEcl2016CreditLinesHaswhat is the amount of credit lines that has been drawn in millions as of year-end 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 481 OUT221
✓
FinQaEog2018ConsideringEndingBalanceconsidering the years 2016-2018 , what is the average ending balance for valuation allowances for deferred income tax assets?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 254 OUT1 480
✓
FinQaEtr2011DecreaseReceivablesMoneywhat is the percentage decrease in receivables from the money pool from 2010 to 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 344 OUT1 180
✓
FinQaGpn2010FairNonVestedwhat is the percentage change in the total fair value of non-vested shares from 2009 to 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN2 170 OUT447
✓
FinQaGpn2013LeasePaymentsWillwhat percentage of lease payments will be paid out in the first year?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 895 OUT426
✓
FinQaGs2015FutureMinimumRental2what percentage of future minimum rental payments are due after 2020?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 282 OUT415
✓
FinQaGs2017FourthQuartersTierin millions for the fourth quarters of 2017 and 2016 , what was the total tier 1 capital?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 335 OUT560
✓
FinQaHum2014StockPricePerformancewhat was the percent of the change in the stock price performance for hum from 2010 to 20111 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 620 OUT327
✓
FinQaIp2006BrazilianPaperSalesbrazilian paper sales represented what percentage of printing papers in 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 804 OUT327
✓
FinQaL2009ReturnInvestmentwhat is the return on investment for s&p500 from 2004 to 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 855 OUT338
✓
FinQaMro2004NumberSharesPurchasedwhat percentage of total number of shares purchased were repurchased in open-market transactions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 240 OUT332
✓
FinQaMro2007DecemberUnrecognizedCompensationas of december 31 , 2007 , how much unrecognized compensation cost related to restricted stock awards is expected to be recognized in 1 year , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 605 OUT1 242
✓
FinQaMro2008MilesPrivateCrudewhat was total miles of private crude oil pipelines and private refined products pipelines?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 181 OUT168
✓
FinQaPm2017PreTaxPensionwhat is the percentage change in the pre-tax pension and postretirement expense from 2017 to 2018?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 451 OUT377
✓
FinQaRsg2018DecemberDeclineAllowanceas of december 31 , 2018 what was the percentage decline in the allowance for doubtful accounts1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 007 OUT531
✓
FinQaStt2009MoreNetGainsby how much more is the net gains from sales of available-for-sale securities in 2009 compare to 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 459 OUT902
✓
FinQaUps2012RoiInvestmentUpswhat is the roi of an investment in ups from 2008 to 2009?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 746 OUT292
✓
FinQaVno2014FiveVornadoRealtywhat was the five year change in the vornado realty trust index?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 596 OUT278
Reasoning - FinQA annual report calculations (set 30) 33 passed
100.0%
 IN79 167 OUT22 222
✓
FinQaAbmd2005RiskFreewhat is the percentage change in the risk-free rate from 2003 to 2004?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 206 OUT397
✓
FinQaAbmd2005RiskFree2what is the percentage change in the risk-free rate from 2004 to 2005?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 206 OUT424
✓
FinQaAbmd2007GrowthWeightedFairwhat is the growth rate in the weighted average fair value for options granted between 2006 to 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 514 OUT356
✓
FinQaAbmd2012IncreaseBaseRent2what is the percentage increase in base rent for danvers , massachusetts facility from the period 2010-2014 to 2014-2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 341 OUT429
✓
FinQaAbmd2012RoiInvestmentAbiomedwhat is the roi of an investment in abiomed inc from march 2007 to march 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 762 OUT265
✓
FinQaAdi2019BoardDirectorsIncreasein 2008 , how much percent did the board of directors increase the share repurchase program .1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 031 OUT1 554
✓
FinQaAdi2019MoneyCompanyPayhow much money did the company pay for the repurchase of shares on non-announced plans or programs?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 031 OUT3 789
✓
FinQaAlxn2016OutstandingTermLoanwhat portion of total outstanding term loan is due in the next 12 months as of december 31 , 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 434 OUT666
✓
FinQaAnss2012IncurredLeaseRentalwhat is the total amount incurred , in millions , from lease rental expenses related to the company's executive offices from 2010-2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 440 OUT311
✓
FinQaBdx2018RangeLossesUndesignatedwhat is the range of losses on undesignated foreign exchange derivatives , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 130 OUT439
✓
FinQaBkr2017NetCashwhat is the net change in cash during 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 259 OUT230
✓
FinQaBlk2012LongTermBorrowingswhat portion of the total long-term borrowings is due in the next 24 months?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 436 OUT455
✓
FinQaBlk2015FutureMinimumCommitmentswhat portion of the total future minimum commitments under operating leases is due in the next 36 months?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 751 OUT391
✓
FinQaBlk2017CarryingCompanyInterestwhat is the percentage change in the carrying value of company's interest in pennymac from 2016 to 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN3 056 OUT344
✓
FinQaHolx2009PurchaseCashwhat percent of the purchase was in cash?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 043 OUT685
✓
FinQaIp2006CumulativeRentExpensewhat was the cumulative rent expense from 2004 to 2006 in millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 594 OUT754
✓
FinQaIp2006DebtAssociatedLeasewhat was the ratio of the 2007 lease obligations related to discontinued operations and businesses held for sale to the 2007 total debt payments?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 688 OUT561
✓
FinQaIp2006IndustrialPackagingProfitwhat was the industrial packaging profit margin in 20041 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 574 OUT478
✓
FinQaIp2006ProfitMarginPrintingwhat was the profit margin of printing papers in 20051 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 801 OUT544
✓
FinQaIp2009ConsideringPercentualIncreaseconsidering the years 2010-2011 , what is the percentual increase observed in the maturities of long-term debt?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 777 OUT334
✓
FinQaIp2009ConsideringVariationObservedconsidering the years 2011-2012 , what is the variation observed in the lease obligations?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 771 OUT862
✓
FinQaMo2014GrowthNetEarningswhat is the growth rate in net earnings attributable to altria group inc . from 2012 to 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 904 OUT363
✓
FinQaMo2016RoiInvestmentDecemberwhat is the roi of an investment in s&p500 from december 2011 to december 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 097 OUT315
✓
FinQaNclh2018InterestLiborhow much did interest with libor change from year 1 to years 3-5?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 650 OUT1 015
✓
FinQaPpg2006ReserveProductWarranties2what was the change in millions in the reserve for product warranties from 2005 to 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 738 OUT250
✓
FinQaPpg2008NetAccruedLiabilitywhat was the net change in the accrued liability for unrecognized tax benefits from 2007 to 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 429 OUT272
✓
FinQaPpg2012CapitalSpendingRelatedwhat was the difference in millions of capital spending related to business acquisitions from 2010 to 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN3 047 OUT739
✓
FinQaTfx2015WouldRestructuringChargeswhat would the total restructuring charges be without including prior years of 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 243 OUT2 557
✓
FinQaTfx2017RemainingSecuritiesWouldif the remaining securities would be use or exercised at $ 113.49 , what would cost be for the company?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 628 OUT1 125
✓
FinQaUnp2007FreeCashFlowwhat was change in millions of free cash flow from 2005 to 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 238 OUT214
✓
FinQaUnp2007FreeCashFlow2what was change in millions of free cash flow from 2005 to 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 238 OUT259
✓
FinQaUnp2010HadAllFourhad all four quarters of 2010 had the same number of total shares purchased , how many total shares were purchased in 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 904 OUT387
✓
FinQaUnp2015FreightRevenuesIntermodal2what percentage of total freight revenues was the intermodal commodity group in 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 206 OUT458
Reasoning - FinQA annual report calculations (set 31) 33 passed
100.0%
 IN76 961 OUT15 709
✓
FinQaAbmd2006ObligationsOperatingLease2what percentage of total obligations are operating lease obligations in 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 197 OUT364
✓
FinQaAbmd2007GrowthWeightedFair2what is the growth rate in the weighted average fair value for options granted between 2005 to 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 514 OUT366
✓
FinQaAbmd2008ExpectedContingentPaymentswhat is the total expected contingent payments to impella 2019s former shareholders upon fda approval of impella devices , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 340 OUT927
✓
FinQaAbmd2012RoiInvestmentNasdaqwhat is the roi of an investment in nasdaq composite index from march 2007 to march 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 763 OUT796
✓
FinQaBdx2018OtherIncomewhat is the average of total other income from 2016-2018 , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 131 OUT765
✓
FinQaBkr2017NetCash2what is the net change in cash during 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 259 OUT220
✓
FinQaBlk2012LongTermBorrowings2what portion of the total long-term borrowings is due in the next 36 months?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 436 OUT915
✓
FinQaBlk2015AnnualInterestExpensewhat is the annual interest expense related to 201c2019 notes 201d , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 757 OUT808
✓
FinQaBlk2017FairCompanyInterestwhat is the percentage change in the fair value of company's interest in pennymac from 2016 to 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN3 056 OUT382
✓
FinQaCmcsa2008CapitalExpendituresIncurredwhat was the percent of the capital expenditures we incurred in our cable segment in 2006 for the customer premise equipment1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 302 OUT338
✓
FinQaCmcsa2015CapitalExpendituresIncurredwhat was the percentage of the capital expenditures incurred in our cable communications for customer premise equipment in 20151 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 076 OUT350
✓
FinQaCmcsa2015NolCarryForwardin 2015 what was the ratio of the nol carry forward for the federal to the foreign taxes1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 282 OUT254
✓
FinQaCmcsa2015ReviewReconciliationUnrecognizedbased on the review of the reconciliation of unrecognized tax benefits what was the change in 20141 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 281 OUT886
✓
FinQaIp2006DebtComparedLeasein 2007 what was the percent of total debt in the total contractual obligations for future payments?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 683 OUT255
✓
FinQaIp2006FutureMinimumCommitmentswhat was the percentage of total future minimum commitments under existing non-cancelable leases and purchase obligations associated with purchase obligations in 20071 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 602 OUT548
✓
FinQaLkq2016CumulativeRentalExpensewhat was the cumulative rental expense from 2014 to 2016 in millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 889 OUT266
✓
FinQaLkq2016FutureMinimumLeasein 2016 what was the percent of the total future minimum lease commitments due in 20191 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 893 OUT426
✓
FinQaMo2014GrowthNetEarnings2what is the growth rate in net earnings attributable to altria group inc . from 2013 to 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 904 OUT451
✓
FinQaMo2014SmokelessProductsShipmentswhat portion of total smokeless products shipments are related to copenhagen segment during 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 933 OUT429
✓
FinQaMo2014SmokelessProductsShipments2what portion of total smokeless products shipments are related to copenhagen segment during 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 933 OUT319
✓
FinQaNclh2018LongTermDebtwhat percent of long-term debt was paid off in 2021?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 212 OUT397
✓
FinQaPpg2008NetAccruedLiability2what was the percentage net change in the accrued liability for unrecognized tax benefits from 2007 to 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 430 OUT672
✓
FinQaPpg2012CapitalSpendingRelated2what was the difference in millions of capital spending related to business acquisitions from 2011 to 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN3 047 OUT709
✓
FinQaUnp2006RouteMilesMainwhat percent of total route miles are main line in 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 068 OUT598
✓
FinQaUnp2006RouteMilesMain2what percent of total route miles are main line in 2005?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 064 OUT291
✓
FinQaUnp2009MaterialObligationsCommitmentswhat percent of total material obligations and commitments as of december 31 , 2009 are operating leases?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 320 OUT389
✓
FinQaUnp2009MaterialObligationsCommitments2what percent of total material obligations and commitments as of december 31 , 2009 are capital leases?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 320 OUT281
✓
FinQaUnp2010MoreSpentShareshow much more was spent on shares in nov 2010 than dec 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 894 OUT723
✓
FinQaUnp2011Equity2what was the change in millions of average equity from 2009 to 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 457 OUT258
✓
FinQaUnp2011FreeCashFlowwhat was the percentage change in free cash flow from 2009 to 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 267 OUT284
✓
FinQaUnp2011FreeCashFlow2what was the percentage change in free cash flow from 2010 to 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 267 OUT291
✓
FinQaUnp2016MathematicalRangeChemicalwhat is the mathematical range for chemical revenue from 2014-2016 , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 210 OUT264
✓
FinQaVrtx2006PropertyEquipmentNetwhat was the ratio of the total property and equipment net in 2006 to 20051 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 174 OUT487
Reasoning - FinQA annual report calculations (set 32) 31 passed2 failed
93.9%
 IN74 569 OUT26 408
✓
FinQaAal2010PensionRetireeMedicalfrom 2016-2020 what was the ratio of the pension to the retiree medical and other service costs1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 988 OUT309
✓
FinQaAes2002DecreaseRentalExpensewhat was the decrease in rental expense ( millions ) for operating leases from 2001 to 2002?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 036 OUT1 365
✓
FinQaAmat2013ReturnInvestedSoldwhat is the gain , in dollars , if $ 100000 is invested in the s&p 500 index in 2008 and sold in 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 072 OUT480
✓
FinQaAmt2006EmployeeLiabilitySeparationsin 2004 what was the percent of the change in the employee liability for employee separations1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 474 OUT515
✓
FinQaAmt2007WoburnPropertyOwnedwhat portion of the woburn property owned by the american tower corporation is subleased?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 998 OUT877
✓
FinQaAmt2012PursuantAgreementMarchpursuant to the agreement , on march 30 , 2012 , what was the approximate price for each site the company purchased in thousands1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 175 OUT382
✓
FinQaAon2015AggregateIntrinsicStockwhat was the average aggregate intrinsic value of stock options exercised from 2013 to 20151 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN2 091 OUT540
✓
FinQaAon2015NumberSharesIssuedwhat was the average number of shares issued to employees under the u.s . employee share purchase plan from 2013 to 20151 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 099 OUT340
×
FinQaBlk2014FutureNotesDuewhat percent of future minimum operating lease commitments are due by 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
Assertion expression evaluated to false: difference <= tolerance Context: answer: 0.2857, expected: 0.29626 Values: difference = 0.010560000000000014 tolerance = 0.0029626
 Failed IN2 869 OUT2 013
✓
FinQaCme2010IncreaseCashDuewhat was the ratio of the new issuances of debt in 2008 to the net debt reductions in debt instruments in 2009?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 407 OUT1 658
✓
FinQaCme2010ReceivablesBrokersOtherwhat was the percentage change in receivables from brokers with in other current assets from 2009 to 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 040 OUT321
✓
FinQaCme2017AnualizedReturnwhat is the anualized return for s&p 500 from 2012 to 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN1 756 OUT769
✓
FinQaEcl2016CashEquivalentsHandwhat fraction of cash and cash equivalents on hand was held in the u.s . as of december 31 , 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 487 OUT352
✓
FinQaGis2019SalesGrowthwhat is the sales growth rate from 2017 to 2018?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 155 OUT508
✓
FinQaHolx2009PurchaseShareHologicduring the purchase , what was the per share value of the hologic common stock1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 050 OUT448
✓
FinQaHwm2017AnnualizedReturnAematerialswhat is the annualized return for the s&p 500 aematerials index during 2012 and 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN1 855 OUT855
✓
FinQaIlmn2008SharePriceWarrantsduring 2008 what was the average cash proceeds per warrant exercised , in dollars?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 247 OUT506
×
FinQaIp2006SumEuropeanPaperswhat was the sum of the european papers net sales from 2004 to 2006 , in billions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
Assertion expression evaluated to false: difference <= tolerance Context: answer: 4400, expected: 4.4 Values: difference = 4395.6 tolerance = 0.044000000000000004
 Failed IN2 809 OUT364
✓
FinQaIpg2017DecreaseContingentAcquisitionwhat is the percentage decrease in total contingent acquisition payments from 2018-2019?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 227 OUT892
✓
FinQaJpm2010WholesaleCreditExposurewhat was the percentage change in total wholesale credit exposure from 2009 to 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 494 OUT503
✓
FinQaL2009GrowthIndexDecemberwhat was the growth rate of the s&p 500 index from december 31 , 2004 to 20071 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 861 OUT415
✓
FinQaLmt2014AggregateNotionalOutstandingin 2014 what was the ratio of the aggregate notional amount of outstanding interest rate swaps to the outstanding foreign currency hedges1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 220 OUT738
✓
FinQaMar2018ContractualObligationsOff2of the total contractual obligations and off-balance sheet arrangements contractual obligations what percentage is due to capital lease obligations?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 575 OUT451
✓
FinQaMas2017CumulativeShareholderReturn2what was the difference in percentage cumulative total shareholder return on masco common stock versus the s&p 500 index for the five year period ended 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN1 844 OUT508
✓
FinQaMsi2014ExpectedVolatilitywhat is the percent change in expected volatility between 2012 and 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 691 OUT360
✓
FinQaMsi2014WeightedEstimatedFairwhat was the percentage change in the weighted-average estimated fair value of employee stock options granted during from 2013 to 20141 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 700 OUT601
✓
FinQaPnc2012AssetsEndedDechow many total assets were there at year ended dec 31 , 2011 , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 453 OUT4 242
✓
FinQaSna2007CashDividendsPaidwhat was the percentage change in the cash dividends paid per common share from 2006 to 20071 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 600 OUT603
✓
FinQaSna2007MinorityInterestwhat was the percentage increase in the minority interests deduction from 2005 to 20061 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 502 OUT1 563
✓
FinQaSna2012FairNonVestedwhat is the total fair value of the non-vested performance awards at beginning of year , ( in thousands ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 345 OUT818
✓
FinQaStt2009AggregateNetAsset2what was the percent change in the aggregate net asset values of the collateral pools underlying ssga lending funds between 2008 and 2009?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 910 OUT338
✓
FinQaStt2009NetUnrealizedLosswhat was the percent change in net unrealized loss on available-for-sale securities between 2008 and 2009?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 458 OUT753
✓
FinQaV2014IncreaseFairOptionwhat is the percentage increase in the fair value of option granted from 2013 to 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 081 OUT1 021
Reasoning - FinQA annual report calculations (set 33) 32 passed1 failed
97.0%
 IN73 252 OUT25 958
✓
FinQaAal2010DecreaseMinimumContributionwhat is the percentage decrease in the minimum contribution to benefit pension plans due to the relied act?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 980 OUT579
✓
FinQaAbmd2005AssumingSameGrowthassuming the same rate of growth as in 2005 , what would the projected risk free interest rate be in 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 213 OUT784
✓
FinQaAes2001PriorFirstRemarketingprior to the first remarketing date , what is the annual interest cost on the remarketable or redeemable securities ( 2018 2018roars 2019 2019 ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 266 OUT783
✓
FinQaAmt2010OutstandingAmountsUnderwhat percentage of outstanding amounts under the company 2019s long-term financing arrangements is current in 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 339 OUT414
✓
FinQaAmt2014WouldContingentConsiderationwhat would 2014 contingent consideration be without the foreign currency translation adjustment , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 191 OUT426
✓
FinQaAnet2015DecemberPurchaseCommitmentsas of december 31 , 2015 , are purchase commitments greater than expected 2016 lease commitments?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 974 OUT328
✓
FinQaAwk2018CompanyRepurchasedSharesthe company repurchased how many million shares of common stock in the open market for the years ended december 31 , 2018 and 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 719 OUT1 340
✓
FinQaBlk2017UnamortizedDiscountDebtwhat percent does the unamortized discount and debt issuance costs reduce the carrying amount by?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN3 045 OUT1 767
✓
FinQaBll2006CurrentAssetsNetcurrent assets were what percent of net assets acquired for the can and alcan transactions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 026 OUT3 070
✓
FinQaBll2010ProductivityPlasticsBusinessproductivity in the plastics business measured by million $ sales per employee was what in 2009?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 316 OUT995
✓
FinQaCe2016ResearchDevelopmentCostswhat was the percentage change in the the research and development costs from 2014 to 20151 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 151 OUT338
✓
FinQaDre2008BasicNetIncomewhat was the average basic net income available for common shareholders from 2006 to 2008 in millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN2 327 OUT475
✓
FinQaDre2008NetIncomeCommon2what is the net income per common share in 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 317 OUT472
✓
FinQaFis2012ImpactEuroEarnings2what was the percentage change in the impact of the euro on earnings from 2011 to 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 639 OUT625
✓
FinQaGpn2013ExpectedMinimumPaymentswhat is the percentage change in the expected minimum payments from 2014 to 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 904 OUT682
✓
FinQaGs2012RiskWeightedAssets2what was the percentage change in risk-weighted assets at gs bank usa between 2011 and 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 489 OUT483
✓
FinQaGs2015SecuritiesPurchasedUnderwhat was the percentage change in securities purchased under agreements to resell between 2014 and 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 221 OUT364
✓
FinQaHig2011ReinsuranceAccountswhat was the percentage change in the increase in net asbestos reserves from 2009 to 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 220 OUT660
✓
FinQaIntc2013IncreaseDowJoneswhat was the percent of the increase in the dow jones u.s . technology index from 2011 to 20121 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 651 OUT311
✓
FinQaIp2006BrazilianPaperSales2brazilian paper sales represented what percentage of printing papers in 2005?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 804 OUT542
✓
FinQaJkhy2019GrowthCumulativeReturnwhat was the percentage growth of the 5 year- cumulative total return for the 2018 peer group from 2016 to 20171 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 054 OUT512
✓
FinQaJpm2010LoansRetainedwhat was the percentage change in loans retained from 2009 to 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 492 OUT373
✓
FinQaJpm2014LoansRetainedwhat was the percentage change in loans retained from 2013 to 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 471 OUT460
✓
FinQaK2013SgaDueProjectwhat percent of 2013 reported sga is due to project k?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 843 OUT2 219
✓
FinQaLmt2015NetEarningsContinuingwhat was the percentage change in net earnings from continuing operations from 2014 to 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 330 OUT352
✓
FinQaPnc2012PrivateInvestorRepurchasehow many total private investor repurchase claims were there in 2011 and 2012 combined , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 952 OUT795
✓
FinQaPpg2018EnvironmentalReservesGreaterare the 2018 environmental reserves greater than asbestos-related claim reserves?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 387 OUT314
✓
FinQaRl2008FactoryRetailStores2what percentage of factory retail stores as of march 29 , 2008 where located in japan?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 091 OUT591
✓
FinQaRsg2015AccountBalancein 2015 what was the the percentage change in the account balance1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 030 OUT380
✓
FinQaRsg2015DecemberRestrictedCashin december 2015 what was the ratio of the restricted cash and marketable securities to the allowance for doubtful accounts1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 039 OUT694
×
FinQaSlb2012StockRepurchaseProgramthe stock repurchase program reduced shares outstanding by how many million shares in the period?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
Assertion expression evaluated to false: difference <= tolerance Context: answer: 14, expected: 78 Values: difference = 64 tolerance = 0.78
 Failed IN1 719 OUT2 327
✓
FinQaSna2007RepurchasePriceSharewhat is the average repurchase price per share paid during 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 592 OUT459
✓
FinQaUnp2011SimilarImprovementWouldwith a similar improvement as in 2010 , what would expected operating ratio be in 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 460 OUT1 044
Reasoning - FinQA annual report calculations (set 34) 33 passed
100.0%
 IN75 683 OUT21 128
✓
FinQaAal2015ProfessionalFeesPartwhat is the percent of the professional fees as part of the total re-organization costs1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 097 OUT255
✓
FinQaAbmd2012FutureMinimumLeasewhat portion of total future minimum lease payments are due in fiscal 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 319 OUT408
✓
FinQaAmt2008EmployeeSeparationsLiabilitiesin 2006 what was percentage change in the employee separations liabilities1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN3 442 OUT351
✓
FinQaAwk2017WeightedInterestRateswhat was the percentage change in the weighted average interest rates computed on daily basis from 2016 to 20171 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 168 OUT367
✓
FinQaCb2010BalanceTreasurywhat is the percentage change in the balance of treasury in 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 007 OUT881
✓
FinQaCme2010DecemberParDebtas of december 31 , 2010 what was the ratio of the par value of the debt outstanding for the fixed rate notes due february 2014 to the term loan due 20111 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 426 OUT560
✓
FinQaDg2007ImpairmentChargesIncluded2what was the amount of the total impairment charges included in sg&a expense from 2005 to 2007 in millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 823 OUT1 215
✓
FinQaDre2007BasicNetIncome2what is the percent change in basic net income available for common shareholders from 2006 to 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 191 OUT326
✓
FinQaDre2007NetIncomeCommonwhat is the net income per common share for the year 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 182 OUT1 027
✓
FinQaEtfc2018PreTaxGainwhat was the ratio of the unrealized pre-tax gain to the carrying value of the securities transferred from held-to-maturity securities to available-for-sale securities?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 110 OUT425
✓
FinQaEtr2016PaymentsNextThreewhat are the payments for the next three years on the entergy new orleans storm recovery bonds ( in millions? )1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 315 OUT767
✓
FinQaEtr2017NetRevenueDecreasewhat percent did net revenue decrease between 2016 and 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 712 OUT2 929
✓
FinQaEtr2017WithoutLossVolumewithout the loss of in volume/weather , what percent increase would net revenue have experienced between 2016 and 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 722 OUT647
✓
FinQaFis2016ReturnInvestedFidelitywhat is the dollar gain if $ 100000 are invested in fidelity national information system in 12/11 and sold in 12/16?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 694 OUT401
✓
FinQaGs2015SecuritiesSoldUnderwhat was the percentage change in securities sold under agreements to repurchase between 2014 and 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 221 OUT455
✓
FinQaIp2009RentIncrease2what was the percentage rent increase between 2008 and 2009?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 703 OUT451
✓
FinQaJpm2009TradingAssetsDerivativesin 2008 what was the ratio of the trading assets derivatives - receivables to the payables1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 805 OUT359
✓
FinQaJpm2015NetRevenueInterest2what percentage of total net revenue in 2015 was net interest income?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 752 OUT208
✓
FinQaK2006NetCashOperationsby what percent did net cash from operations increase between 2004 and 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 615 OUT369
✓
FinQaL2009GrowthLoewsCommonwhat was the growth rate of the loews common stock from december 31 , 2004 to 20091 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 858 OUT294
✓
FinQaLmt2014OperatingMarginwhat was the difference in operating margin between 2012 and 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 459 OUT899
✓
FinQaLmt2014WeightedCommonShares3what was the average weighted average common shares outstanding for diluted computations from 2012 to 20141 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 216 OUT602
✓
FinQaLmt2015NovemberCostsAssociatedin november 2015 what was the percent of the costs associated with issuing of the notes under the 364-day facility used to finance the acquisition1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 339 OUT516
✓
FinQaPm2017BasisPointsPostretirementwhat is the change in basis points of the rate of postretirement plans from 2016 to 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 451 OUT1 153
✓
FinQaRsg2018DeclineEquityActualwhat was the percentage decline in the equity from 2017 to 2018 actual1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 953 OUT1 779
✓
FinQaSlg2011BalanceVestedwhat percentage of the beginning balance of 2010 was vested during the year?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN3 452 OUT238
✓
FinQaSna2007CashDividendsPaid2based on the cash dividends paid in 2007 , how many common stock shares were outstanding?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 600 OUT995
✓
FinQaSna2007CashFlowProvidedwhat was the average cash flow provided from operating activities from 2005 to to 2007 $ 231.1 million in 2007 , $ 203.4 million in 2006 , and $ 221.1 million in 2005 .1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 644 OUT462
✓
FinQaSna2013TradeOtherAccountswhat percentage of trade and other accounts receivable are considered as doubtful receivables in 20131 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 114 OUT275
✓
FinQaStt2007IndemnifiedSecuritiesFinancingwhat is the percent change in indemnified securities financing between 2006 and 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 116 OUT306
✓
FinQaUps2010ExpectedCashOutflow2what percentage of total expected cash outflow to satisfy contractual obligations and commitments as of december 31 , 2010 are due in 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 343 OUT471
✓
FinQaWrk2018BalanceCompanyIncludewhat was the total balance in 2018 , if the company was to include interest and penalty liabilities?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 417 OUT348
✓
FinQaWrk2018BalanceCompanyInclude2what was the total balance in 2018 , if the company was to include interest and penalty liabilities?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 417 OUT389
Reasoning - FinQA annual report calculations (set 35) 3 passed
100.0%
 IN6 945 OUT964
✓
FinQaAnss2012RoyaltyFeesReportedwhat was the percentage change in the royalty fees are reported in cost of goods sold from 2011 to 20121 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 435 OUT342
✓
FinQaSna2012NumberSharesNotin 2012 what was the percent change in the number of shares that was not vested1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 341 OUT315
✓
FinQaVrtx2006GrossRealizedGainsin 2006 what was the ratio of the gross realized gains to the losses1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 169 OUT307
Reasoning - FinQA annual report calculations (set 4) 33 passed
100.0%
 IN75 590 OUT18 933
✓
FinQaAal2013BankruptcySettlementObligationswhat portion of the total bankruptcy settlement obligations are related to single-dip equity obligations?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 453 OUT261
✓
FinQaAdbe1999NetBalanceAccrualwhat is the net change in the balance of accrual related to restructurings during 1999?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 009 OUT1 061
✓
FinQaAmt2003ExpectedAggregatePrincipalwhat is the expected percentage change in aggregate principal payments of long-term debt from 2004 to 2005?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 589 OUT351
✓
FinQaAmt2012QuarterDecemberNumberfor the quarter december 31 , 2012 what was the percent of the total number of shares purchased in december1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 978 OUT476
✓
FinQaAmt2014RentExpenseGreaterwas 2014 rent expense greater than 2015 operating lease expense?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 989 OUT930
✓
FinQaAmt2016GrowthPriceShareswhat is the growth rate in the price of shares from the highest value during the quarter ended december 31 , 2016 and the closing price on february 17 , 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 066 OUT444
✓
FinQaAon2007NetBalanceAccumulatedwhat is the net change in the balance of accumulated other comprehensive loss from 2006 to 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 478 OUT290
✓
FinQaAwk2014NetTaxPositionswhat was the net change in tax positions in 20141 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 230 OUT580
✓
FinQaC2008AfterTaxGainswhat was the total after-tax gains in millions for the sale so mastercard shares from 2006 to 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 380 OUT340
✓
FinQaC2018PrincipalTransactionsRevenuewhat percentage of total principal transactions revenue in 2018 was do to interest rate risks?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 783 OUT446
✓
FinQaDisca2011CumulativeShareholderReturnwhat was the percentage cumulative total shareholder return on disca from september 18 , 2008 to december 31 , 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 910 OUT376
✓
FinQaDre2002GeneralAdministrativeExpensewhat is the percent change in general and administrative expense from 2000 to 2001?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 632 OUT351
✓
FinQaDre2008NetIncomeCommonwhat is the net income per common share in 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 317 OUT901
✓
FinQaEtr2016WouldNetRevenuewhat would 2015 net revenue have been in millions assuming there was no impact from both the retail electric price change and the impact of volume/weather in the year?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 160 OUT505
✓
FinQaGpn2008NetAssetsAcquiredwhat percentage of net assets acquired was considered goodwill?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 843 OUT321
✓
FinQaGpn2010CompensationExpenseRestrictedwhat was the total compensation expense for restricted stock recognized from 2008 to 20101 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 163 OUT953
✓
FinQaGs2014InventoryBalancewhat is the percentage change in inventory balance in 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 461 OUT520
✓
FinQaIp2006DecemberFutureMinimumat december 31 , 2006 , what percentage of total future minimum commitments under existing non-cancelable leases and purchase obligations from lease obligations is due in 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 606 OUT267
✓
FinQaJpm2010DecemberCollateralAbleas of december 31 , 2010 what percentage of the collateral that it was able to sell , repledge , deliver , or otherwise use was actually used for these purposes?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 947 OUT469
✓
FinQaJpm2018BasisPointsNetby how many basis points did net interest yield on average interest-earning assets 2013 managed basis improve form 2016 to 2017?\\n1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN3 699 OUT1 562
✓
FinQaK2013UnderlyingOperatingProfitif 2014 underlying operating profit increases at the same pace as 2013 , what would it be , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 856 OUT1 006
✓
FinQaMktx2012HighMktxStockby how much did the high of mktx stock increase from 2011 to march 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 007 OUT421
✓
FinQaMro2003ProtectCarryingValuesby what percentage did protect carrying values of excess inventories increase from 2002 to 2003?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 193 OUT884
✓
FinQaMro2013WorldwideNetAcreagewhat was average worldwide net acreage expiring in the total three year period , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 417 OUT428
✓
FinQaNclh2018CapitalizedInterestwhat is the percentage change in capitalized interest from 2017 to 2018?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 652 OUT844
✓
FinQaPnc2007ResidentialMortgageLoanfor 2007 and 2006 in millions , what was average residential mortgage loan balance?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 091 OUT237
✓
FinQaPnc2012ResidentialMortgagesIncreaseby what percentage did total residential mortgages increase from 2011 to 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 518 OUT346
✓
FinQaPnc2014EquityInvestmentBalanceswhat was the change in millions in the unfunded commitments included in equity investment balances from december 31 , 2013 to december 31 , 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 281 OUT1 501
✓
FinQaRsg2016TonsHedgedwhat was the ratio of the tons hedged in 2017 to 20181 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 776 OUT373
✓
FinQaSna2012NetChanceNonwhat is the net chance in non-vested performance awards in 2012 , ( in thousands ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 345 OUT292
✓
FinQaUps2007ExpectedCashOutflowwhat is the total in millions of expected cash outflow to satisfy contractual obligations and commitments as of december 31 , 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 340 OUT437
✓
FinQaZbh2007AcquisitionIntegrationOtherwhat is the percent change in total acquisition integration and other expenses from 2006 to 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 642 OUT349
✓
FinQaZbh2009ContractualObligationsMadewhat percentage of total contractual obligations is made up of interest payments?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 779 OUT411
Reasoning - FinQA annual report calculations (set 5) 32 passed1 failed
97.0%
 IN70 362 OUT17 658
✓
FinQaAbmd2012AbiomedOutperformNasdaqdid abiomed outperform the nasdaq medical equipment index?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 748 OUT256
✓
FinQaAdbe2008FinGrossLiabilityif the total fin 48 gross liability for unrecognized tax benefits at november 28 , 2008 were recognized in the future , is the amount of unrecognized tax benefits that would decrease the effective tax rate greater than the amount that would decrease goodwill?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 231 OUT258
✓
FinQaAes2001CompaniesHighComparedwhat was the difference in the companies high compared to its low sales price for the second quarter of 2001?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 801 OUT347
✓
FinQaAnet2015CurrentPresentLeasewhat is the current portion of the present value of lease obligations?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 960 OUT472
✓
FinQaAon2007AdditionsTaxPositionswhat is the difference between the additions for tax positions of prior years and the current year , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 695 OUT201
✓
FinQaAwk2014CanadianNolStatewhat was canadian nol's as a percentage of state nol's in 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 235 OUT374
✓
FinQaBll2012RoiInvestmentContainerswhat is the roi of an investment in dj us containers & packaging from 2007 to 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 657 OUT284
✓
FinQaCb2010FairFinancialMarket2what is the percent change in the fair value financial market instruments as part of the hedging strategy during 2010 compare to 2009?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 371 OUT405
✓
FinQaCe2016NetSpentResearchwhat is the net change in the amount spent for research and development in 2016 compare to 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 154 OUT845
✓
FinQaCmcsa2015CableDistributionSystemswhat was the percentage cable distribution systems capital expenditures of the capital expenditures incurred in cable communications segment capital expenditures in 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 080 OUT471
✓
FinQaCmcsa2015CableDistributionSystems2what was the percentage cable distribution systems capital expenditures of the capital expenditures incurred in cable communications segment capital expenditures in 2015?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 080 OUT557
✓
FinQaCme2017CmeGroupIncdid the cme group inc . outperform the s&p 500 over 5 years?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 751 OUT281
✓
FinQaDg2007ImpairmentChargesIncludedwhat was the change in millions of impairment charges included in sg&a expense from 2006 to 20071 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 821 OUT263
✓
FinQaDg2010MaximumDepreciationCanwhat is the maximum depreciation rate that can be used for furniture fixtures and equipment?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 829 OUT254
✓
FinQaEog2018ConsideringUnrecognizedTaxconsidering the year 2018 , what is the percentage of unrecognized tax benefits that may have an earnings impact?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 249 OUT216
✓
FinQaEtr2008CashFlowEntergyby how much , in thousands , did entergy gulf states louisiana's receivable from the money pool decrease from 2007 to 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 154 OUT1 839
✓
FinQaFis2016LongTermDebtwhat portion of the long-term debt is due in the next 12 months?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 356 OUT734
✓
FinQaGpn2018UnvestedRestrictedStockwhat was the value in thousands of unvested restricted stock and performance awards at the weighted-averagegrant-datefair value as of december 31 , 2017?\\n1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 311 OUT296
✓
FinQaGs2012MaximumTierCapitalin millions for 2012 and 2011 , what was the maximum tier 2 capital?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 486 OUT204
✓
FinQaGs2017MinimumBalanceCashin millions for 2017 and 2016 , what was the minimum balance of cash instruments?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 122 OUT178
✓
FinQaHolx2006EstimatedPurchasePricewhat percentage of the estimated purchase price is goodwill?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 073 OUT520
✓
FinQaHst2018UnrecognizedTaxBenefitswhat was the change in million of the unrecognized tax benefits between 2017 and 2018?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 875 OUT427
✓
FinQaIp2006IndustrialPackagingSaleswhat percentage of 2005 industrial packaging sales are containerboard sales?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 577 OUT640
✓
FinQaJkhy2017StockPerformancewhat was the percentage change in the s&p 500 stock performance from 2014 to 20151 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 773 OUT513
✓
FinQaLmt2012WeightedCommonShareswhat is the percentage change in the weighted average common shares outstanding for basic computations from 2010 to 2011?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 195 OUT437
✓
FinQaMktx2004DecemberSharesCommonas of december 31 , 2004 , how many total authorized shares of common stock and non-voting common stock did the company have?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 209 OUT246
×
FinQaMro2003DistillatesSalesThreewhat was the sum of distillates sales volumes , in thousands of barrels per day , for the three year period?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
Assertion expression evaluated to false: difference <= tolerance Context: answer: 385.44, expected: 1056 Values: difference = 670.56 tolerance = 10.56
 Failed IN2 176 OUT2 650
✓
FinQaMro2013AcresExpiringOtherwhat was total acres expiring in millions for other africa?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 410 OUT374
✓
FinQaPnc2012PotentialMaximumExposureby what percentage did the potential maximum exposure decrease by the end of 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 360 OUT1 472
✓
FinQaPnc2012TdrsAssociatedCommercialin 2012 what was the percent of the total tdrs that was associated with commercial loans1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 298 OUT292
✓
FinQaSlg2001Revenuewhat was the average total revenue in 1999 , 2000 and 2001?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 650 OUT504
✓
FinQaUps2007CashInflowStockwhat is the total cash inflow from the stock purchases of employees in 2007 , ( in millions ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 035 OUT289
✓
FinQaZbh2015ExpenseNetTaxwhat was the change in total expense net of tax for share based compensation from 2014 to 2015 in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 640 OUT559
Reasoning - FinQA annual report calculations (set 6) 31 passed2 failed
93.9%
 IN73 981 OUT25 877
✓
FinQaAal2016PassengerServicePersonnelwhat is the percent of the passenger service personnel as a part of the total number of personnel1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 220 OUT602
✓
FinQaAapl2003NetAssetRetirementwhat was the net change in millions of asset retirement liability in the year ended september 27 2003?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 374 OUT334
✓
FinQaAbmd2007AssumingSameAppreciationassuming the same appreciation as 2007 , what would be the expected 2008 weighted average grant-date fair value for options?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 517 OUT783
×
FinQaAdi2019CashUsedStockwhat is the total cash used of the stock repurchase during september 2019 , ( in millions ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
Assertion expression evaluated to false: difference <= tolerance Context: answer: 45.20, expected: 38.81487 Values: difference = 6.385130000000004 tolerance = 0.3881487
 Failed IN2 033 OUT4 875
✓
FinQaAes2001CompaniesHighCompared2what was the difference in the companies high compared to its low sales price for the fourth quarter of 2001?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 801 OUT251
✓
FinQaAmt2006ConstructionProgressImpairmentwhat was the average construction in progress impairment from 2004 to 2006 im millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 475 OUT338
✓
FinQaAmt2007RangeHeightMonopolewhat is the difference between the maximum and minimum typical height of monopole towers , in feet?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 000 OUT209
✓
FinQaAmt2007WoburnPropertyUsedwhat portion of the woburn property is used by the american tower corporation?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 996 OUT320
×
FinQaAwk2012ChangesCompanyGrossby how much did the company's gross liability , excluding interest and penalties , for unrecognized tax benefits increase from december 31 , 2011 to december 31 , 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
Assertion expression evaluated to false: difference <= tolerance Context: answer: -17849, expected: 22415 Values: difference = 40264 tolerance = 224.15
 Failed IN2 045 OUT589
✓
FinQaC2008NonInterestRevenuewhat was the percentage change in non-interest revenue from 2007 to 2008 , using the absolute value of the 2007 amount as the base?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 086 OUT555
✓
FinQaCdns2018BalanceRetainedEarningswhat is the percentage change in the balance of retained earnings during 2018 after adjustments?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 066 OUT462
✓
FinQaCdw2017GrossMarginwhat was 2017 gross margin percent?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 986 OUT467
✓
FinQaCme2010OtherCurrentAssetswhat percentage of total other current assets in 2010 is represented by the forward contract receivable?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 033 OUT284
✓
FinQaDre2002GainsSalesLandin 2001 , what percent of the total gains on sales ( before the impairment adjustment ) was from the sales of land?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 637 OUT359
✓
FinQaDvn2012DebtMaturityOccurredwhat percentage of total debt maturity occurred in 2018 and thereafter?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 912 OUT250
✓
FinQaEcl2016LongTermDebtwhat percentage of long-term debt is current debt?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 468 OUT269
✓
FinQaEtr2016GrowthNetRevenuewhat is the growth rate in net revenue in 20016 for entergy mississippi , inc.?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 823 OUT274
✓
FinQaFbhs2017CabinetsSalesDoorsin 2017 what was the ratio of the cabinets sales to the doors1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 343 OUT327
✓
FinQaGs2018TableAusNetof the $ 23 billion of 2017 inflows in connection with the verus acquisition , what percentage were in long-term aus?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 571 OUT4 623
✓
FinQaHolx2009FairNonVestedwhat is the total fair value of non-vested shares as of september 26 , 2009?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 179 OUT2 048
✓
FinQaHwm2018ConsideringExercisePriceconsidering the average exercise price of options , what is the increase in the total value of stock options observed during 2016 and 2017 , in millions of dollars?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 613 OUT636
✓
FinQaIp2006ContractualObligationsFuturewhat percentage of contractual obligations for future payments under existing debt and lease commitments and purchase obligations at december 31 , 2006 due in 2007 is attributable to total debt repayments?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 704 OUT411
✓
FinQaIpg2017MathematicalRangeDeferredwhat is the mathematical range of deferred acquisition payments from 2018-2022 , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 229 OUT317
✓
FinQaJpm2008MinimumCapitalRequirementwhat is the minimum capital requirement as defined by the net capital rule in millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 642 OUT278
✓
FinQaLmt2014EmployeeContributionswhat was the average employee contributions from 2012 to 20141 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 297 OUT1 088
✓
FinQaLmt2016OperatingProfitMfcwhat were average operating profit for mfc in millions between 2014 and 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 447 OUT499
✓
FinQaMmm2007RecognizedPreTaxin 2006 what was the percent of the recognized a pre-tax gain to the proceeds of the sale of its global branded pharmaceuticals businesses1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 385 OUT351
✓
FinQaMro2004PricePaidSharebased on the total average price paid per share , what was the total cost of the share repurchases during the 4th quarter of 2004?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 257 OUT706
✓
FinQaPkg2013DecemberEquityCompensationas of december 2013 what was the value of the equity compensation plans approved by security holders to be issued upon exercise of outstanding options warrants and rights1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 889 OUT368
✓
FinQaRsg2018DecemberRestrictedCashas of december 312018 what was the percent of restricted cash and marketable securities dedicated to the support our insurance programs1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 012 OUT276
✓
FinQaSlg2011CompensationCommitteePutwhat amount did the compensation committee put into the maximum performance pool between jan 1 2006 and dec 31 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN3 466 OUT1 247
✓
FinQaStt2006MinimumPensionLiabilitywhat percent did minimum pension liability increase between 2004 and 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 429 OUT820
✓
FinQaUa2007DecemberScheduleCompanyas of december 312007 what was the percent of the schedule of the company 2019s future minimum payments to the total future minimum sponsorship and other marketing payments in 20081 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 046 OUT661
Reasoning - FinQA annual report calculations (set 7) 33 passed
100.0%
 IN77 622 OUT19 271
✓
FinQaAal2016FullTimeEmployeeswhat portion of the total full-time employees of mainline operations are flight attendants?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 219 OUT1 711
✓
FinQaAbc2005SeptemberEmployeesHadas of september 30 , 2005 , what percentage of employees that had received termination notices were actually terminated?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 709 OUT423
✓
FinQaAdi2010GrowthBalanceMutualwhat is the growth rate in the balance of mutual funds in 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 102 OUT273
✓
FinQaAmat2018RoiAppliedMaterialswhat is the roi for applied materials if the investment made on october 2013 was sold 2 years later?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 910 OUT374
✓
FinQaAmt2003DecemberCompanyAggregateas of december 31 , 2004 what was the percent of the the company 2019s aggregate principal payments of long- term debt due in 20081 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 603 OUT681
✓
FinQaCdw2015ExpensedCompanyContributionswhat was the average amount expensed by the company for the company contributions to the profit sharing and other savings plans from 2013 to 2015 in millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 274 OUT396
✓
FinQaCdw2015HadAllPotentialhad all potential common shares been included along with the diluted weighted-average shares outstanding for the year ended dec 31 , 2015 , how many total diluted weighted-average shares would there have been?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 280 OUT597
✓
FinQaCmcsa2008ScalableInfrastructureRepresentsscalable infrastructure represents what percent of capital expenditures incurred the cable segment during 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 296 OUT277
✓
FinQaEtr2015GrowthNetRevenuewhat is the growth rate of net revenue from 2014 to 2015 ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 955 OUT493
✓
FinQaEtr2016GrowthNetRevenue2what is the growth rate in net revenue in 2015 for entergy corporation?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 144 OUT272
✓
FinQaEtr2017SumAnnualLongwhat was the sum of the annual long-term debt maturities outstanding as of december 31 , 2017 , for the next five years1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN2 193 OUT1 346
✓
FinQaGpn2008NetAssetsAcquired2what percentage of net assets acquired was considered goodwill?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 843 OUT371
✓
FinQaGpn2010AfterTaxSharewhat is the after-tax share-based compensation cost in 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 174 OUT1 143
✓
FinQaGs2012RiskWeightedAssetswhat was the change in risk-weighted assets in millions at gs bank usa between 2011 and 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 490 OUT355
✓
FinQaGs2013Assetsin millions for 2013 and 2012 , what was average total assets?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 164 OUT303
✓
FinQaGs2018PreTaxEarningswhat are the pre-tax earnings in 2016 , in billions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 561 OUT851
✓
FinQaIp2006CapitalSpendingContinuingin 2005 what percentage of capital spending from continuing operations was due to consumer packaging?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 527 OUT351
✓
FinQaIp2006DecemberFutureMinimum2at december 31 , 2006 , what percentage of total future minimum commitments under existing non-cancelable leases and purchase obligations from lease obligations is due in 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 606 OUT327
✓
FinQaIp2006IndustrialPackagingSales2what percentage of 2006 industrial packaging sales are containerboard sales?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 577 OUT1 314
✓
FinQaLmt2016OperatingExpenseswhat are the total operating expenses for 2016?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 437 OUT397
✓
FinQaMmm2013DomesticManufacturerDeductionwhat was the percentage change in the domestic manufacturer 2019s deduction activity from 2012 to 20131 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 714 OUT1 197
✓
FinQaMro2006DecemberBeforeTaxas of december 31 , 2005 , what was the before tax charge related to adopting fin no . 47 in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN3 006 OUT310
✓
FinQaMsi2007SegmentNetSaleswhat was the average segment net sales from 2005 to 2007 in millions1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 635 OUT257
✓
FinQaMsi2012NumberSharesPurchasedwhat was the percent change in number of shares purchased by employees between 2010 and 20111 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 480 OUT393
✓
FinQaPkg2005CompanyPurchasedEndedthe company purchased how much in millions during the year ended december 31 , 2004 and during the year ended december 31 , 2003 under purchase agreements?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 021 OUT273
✓
FinQaPkg2013DecemberEquityCompensation2as of december 312013 what was the ratio of the equity compensation plans approved by security holders remaining to be issued to the amount to be issued upon exercise of outstanding1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 894 OUT233
✓
FinQaPpg2006WouldCashExpensewhat would the cash expense for product warranties be in 2007 if the amounts increased the same percentage as in 2006 ( in millions ) ?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 747 OUT1 292
✓
FinQaRcl2016NumberBerthsShipat the end of 2016 , what was the average number of berths per ship in the global cruise fleet?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 970 OUT460
✓
FinQaStt2006GrowthPriceRepurchasedwhat is the growth rate in the average price of repurchased shares from 2005 to 2006?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 435 OUT364
✓
FinQaTfx2017NumberSecuritiesApprovedwhat portion of the total number of securities approved by security holders is issued?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 616 OUT695
✓
FinQaUnp2018ProjectedGrowthOperatingwhat is the 2019 to 2020 projected growth rate for operating lease payments?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 214 OUT284
✓
FinQaUps2007ExpectedDividendSharewhat is the average expected dividend per share in 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 049 OUT510
✓
FinQaZbh2009ContractualObligationsLongwhat percent of total contractual obligations was long-term debt?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 777 OUT748
Reasoning - FinQA annual report calculations (set 8) 33 passed
100.0%
 IN75 917 OUT15 975
✓
FinQaAal2010ExpectedPaidPensionswhat is the total amount expected to be paid for pensions and retiree medical and other in the next 12 months?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 986 OUT1 200
✓
FinQaAapl2004NetAssetRetirementwhat was the net change in asset retirement liability between 2002 and september 25 2004 , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 065 OUT271
✓
FinQaAmt2008ResultSalesCertainas a result of the sales of certain non-core towers and other assets what was the percent of the change in the recorded net losses from 2007 to 20081 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN3 464 OUT1 347
✓
FinQaAmt2014AggregateRentExpensewhat is the percentage change in aggregate rent expense from 2012 to 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 992 OUT870
✓
FinQaAmt2014AggregateRentExpense2what is the percentage change in aggregate rent expense from 2013 to 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 992 OUT475
✓
FinQaAmt2014FutureLeasePaymentswhat portion of future lease payments are due after 5 years?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 983 OUT373
✓
FinQaBlk2012LongTermComponentwhat is the percent change in long-term component changes from 12/31/2011 to 12/31/2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 493 OUT479
✓
FinQaBlk2015FutureCommitmentsDuewhat percent of future commitments are due after 2020?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 744 OUT225
✓
FinQaBll2012RoiInvestmentBallwhat is the roi of an investment in ball corporation from 2007 to 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 654 OUT324
✓
FinQaC2009DecemberAggregateCostat december 31 2009 what was the ratio of the aggregate cost to the fair value of the loans held-for-sale that are carried at locom1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 947 OUT337
✓
FinQaC2015Hqlawhat was the percent of the change in the hqla in the q4 and q3 of 20151 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 383 OUT299
✓
FinQaDisca2011SeriesStockOutperformedby what percent was the value of the $100 investment in disck at december 31 , 2011 greater than the same investment in the s&p 500?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 917 OUT556
✓
FinQaEtr2015OctoberEntergyRecordedin october 2015 , what was the ratio of the entergy recorded a regulatory liability to the tax liability1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 959 OUT443
✓
FinQaEtr2016ExpectedPaymentsBondswhat is the total expected payments on the bonds for the next 5 years for entergy louisiana investment recovery funding?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN2 315 OUT553
✓
FinQaFis2006LeasedLocationsTexaswhat portion of the total leased locations , including those outside the united states , are in texas ( count the number shown for grouped states as the number for each state listed )?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 935 OUT1 533
✓
FinQaGs2017FirmCancelMoredid the firm cancel more stock options during 2017 than it repurchased in common shares?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 472 OUT272
✓
FinQaGs2018LargestProvisionCreditin millions for the years 2018 , 2017 , 2016 , what was the largest provision for credit losses?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 549 OUT153
✓
FinQaIlmn2008UncertainTaxPositionswhat was the percentage change in the uncertain tax positions from 2007 to 2008?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 104 OUT562
✓
FinQaIntc2015SquareFootOwnedwhat is the percent of the square foot in millions owned facilities in the us to the to owned facilities1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 997 OUT256
✓
FinQaIp2006CapitalSpendingContinuing2in 2006 what percentage of capital spending from continuing operations was due to consumer packaging?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 527 OUT723
✓
FinQaIpg2008UnrecognizedTaxBenefitswhat percentage of unrecognized tax benefits , in 2008 , is from tax benefits that would impact effective tax rate if recognized?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 239 OUT265
✓
FinQaJpm2009IncreaseTradingAssetswhat is the increase of the total trading assets between the years 2007 and 2008 , in millions of dollars?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN1 811 OUT423
✓
FinQaJpm2014NetRevenueDuewhat percentage of total net revenue was due to net interest income in 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 753 OUT408
✓
FinQaKhc2018NetIncreaseOutstandingwhat is the net increase in outstanding shares during the period of 2016 to 2018 , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 256 OUT223
✓
FinQaMktx2004CompanyAwardedSharesin 2001 , the company awarded how many total shares to employees?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 194 OUT247
✓
FinQaMro2017GreatestUltimateTrendwhat was the greatest ultimate trend rate for health care costs ? 4.70% ( 4.70 % ) 4.50% ( 4.50 % ) 4.50% ( 4.50 % )1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 499 OUT177
✓
FinQaPpg2008WithoutImpactSettlementswithout the impact of settlements , what would the december 31 2008 amount of unrecognized tax benefits have been , in $ millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 433 OUT242
✓
FinQaPpg2012CostShareRepurchaseswhat was the average cost per share for the share repurchases in 2012?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN3 040 OUT662
✓
FinQaRcl2012IncreasePortCallwhat was the percentage increase in the port call costs included from 2011 to 20121 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 364 OUT360
✓
FinQaSlg2001Revenue2what was the average total revenue in 1999 , 2000 and 2001?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 650 OUT502
✓
FinQaStt2007CollateralHeldIndemnifiedwhat is the percent change of the amount of collateral held for indemnified securities between 2006 and 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 121 OUT373
✓
FinQaUnp2007IncreaseCashProvidedwhat was the percentage increase in the cash provided by operating activities from 2006 to 20071 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 240 OUT367
✓
FinQaZbh2008ContractualObligationsDuewhat percentage of total contractual obligations is due to operating leases?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 839 OUT475
Reasoning - FinQA annual report calculations (set 9) 33 passed
100.0%
 IN75 077 OUT19 734
✓
FinQaAdbe1999RestructuringExpenseBalancefor restructuring expense , what is the total balance of severance and related charges and lease termination costs in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 007 OUT709
✓
FinQaAdbe2008WeightedUsefulLifeis the weighted average useful life ( years ) for purchased technology greater than localization?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 964 OUT148
✓
FinQaAdi2010NotionalUndesignatedHedgeswhat is the percentage change in the total notional amount of undesignated hedges from 2009 to 2010?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 195 OUT354
✓
FinQaAes2001ScheduledMaturitiesDebtwhat percentage of scheduled maturities of total debt at december 31 , 2001 are due in 2002?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 248 OUT681
✓
FinQaAmt2005ImpairmentChargesNetwhat is the percentage change in impairment charges and net losses from 2003 to 2004?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 480 OUT951
✓
FinQaAon2007UnrecognizedTaxBenefitswhat portion of the of unrecognized tax benefits would have an impact in the effective tax rate if recognized?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 693 OUT397
✓
FinQaAwk2017BorrowingsDecreaseby what percentage did average borrowings decrease from 2016 to 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 162 OUT507
✓
FinQaC2008NonInterestRevenue2what was the percentage change in non-interest revenue from 2006 to 2007 , using the absolute value of the 2006 amount as the base?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 086 OUT556
✓
FinQaCme2017AnualizedReturnCmewhat is the anualized return for cme group from 2012 to 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:VeryHardsource:FinQA
 Passed IN1 753 OUT490
✓
FinQaEcl2017StatutoryEffectiveIncomewhat is the difference between the statutory u.s . rate and the effective income tax rate in 2017?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 864 OUT281
✓
FinQaEtfc2012DecemberSquareFootage2as of december 2012 what is the ratio of the square footage in alpharetta , georgia to jersey city new jersey1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 952 OUT714
✓
FinQaEtr2004MoneyPoolActivitywhat is the money pool activity use of operating cash flows as a percentage of receivables from the money pool in 2004?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 160 OUT517
✓
FinQaGrmn2008ConsideringContractualObligationsconsidering the contractual obligations in which payments due by 1-3 years , what is the percentage of the operating leases in relation to the total obligations?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 985 OUT381
✓
FinQaGs2013CommonShareholdersEquitywhat is the percentage change in common shareholders 2019 equity due to the adjustments presented in the table to reach basel iii cet1?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 378 OUT525
✓
FinQaGs2013GrowthAssetswhat is the growth rate in total assets in 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 172 OUT464
✓
FinQaGs2013GrowthFinancialLiabilitieswhat is the growth rate in total financial liabilities at fair value in 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 176 OUT489
✓
FinQaGs2014TrustPreferredSecuritiesfor the trust preferred securities , common beneficial interests and junior subordinated debt extinguished with a recognized gain , how much in millions was not recorded in the third quarter of 2014?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 215 OUT328
✓
FinQaGs2017LevelFinancialAssetswhat was the percentage change in level 3 financial assets from 2016 to 2017 in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 124 OUT384
✓
FinQaHwm2015BiggerInterestPenaltiesin 2015 , by what percent were the interest and penalties recognized greater than the interest income recognized?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 348 OUT431
✓
FinQaJpm2009ExcludingDerivativesNetexcluding derivatives , what are net 2009 trading assets , in millions?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 799 OUT286
✓
FinQaLmt2014IncreaseBacklogwhat was the percent of the increase in the backlog from 2012 to 20131 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 461 OUT332
✓
FinQaMmm2015CompanyContributionQualifiedwhat was the ratio of the company contribution to the us qualified and non-qualified pension benefits for 2015 compared to 20141 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 193 OUT1 385
✓
FinQaMrk2013PercentualDecreaseObservedwhat was the percentual decrease observed in the liabilities for accrued interest and penalties during 2012 and 2013?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 502 OUT812
✓
FinQaNke2009Outstandingwhat is the total amount , in millions of dollars , of outstanding short-term debt obligations as of may 31 , 2009?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN3 261 OUT742
✓
FinQaPnc2012DecemberUnpaidPrincipalat december 31 , 2012 , for unpaid principal balance outstanding of loans sold as a participant in these programs , what was the percentage of potential maximum exposure under the loss share arrangements?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 382 OUT447
✓
FinQaPnc2012HomeEquityUnresolvedfor home equity unresolved asserted indemnification and repurchase claims in millions , what was the change between december 31 2012 and december 31 2011?\\n\\n\\n\\n1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 972 OUT831
✓
FinQaRl2008FactoryRetailStoreswhat percentage of factory retail stores as of march 29 , 2008 where located in europe?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 091 OUT577
✓
FinQaSlg2011EndedDecemberCapitalizedfor the years ended december 31 , 2011 and 2010 in millions , what was the total capitalized to assets associated with compensation expense related to our long- term compensation plans , restricted stock and stock options?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN3 483 OUT331
✓
FinQaSyy2006RentalExpenseUnder2what was the percentage change in total rental expense under operating leases from july 1 , 2006 to july 2 , 2007?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 658 OUT2 020
✓
FinQaUa2011DecreaseWeightedInterestwhat was the percentage decrease in the weighted average interest rates on outstanding borrowings from 2010 to 20111 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 363 OUT1 123
✓
FinQaUnp2010QuarterEndedDecemberfor the quarter ended december 312010 what was percent of the total number of shares purchased in november1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN1 896 OUT626
✓
FinQaUnp2018ProjectedGrowthCapitalwhat is the 2019 to 2020 projected growth rate for capital lease payments?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Hardsource:FinQA
 Passed IN2 214 OUT600
✓
FinQaZbh2008ContractualObligationsDue2what percentage of total contractual obligations is due to long-term debt?1 AI query 0 tool callscategory:ContextProcessingcategory:Reasoninglevel:Mediumsource:FinQA
 Passed IN2 840 OUT315