You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-13 - 18:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackfslot7s.osadl.org (updated Mon Jul 13, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
154903899340310,3387cyclictest1569858-21kworker/1:0+events20:15:191
154903499338316,3362cyclictest1614684-21kworker/0:2+events22:45:010
154903899335810,3343cyclictest1569858-21kworker/1:0+events20:20:131
154904299328516,3265cyclictest1651343-21kworker/2:2+events00:35:212
154904299328212,3266cyclictest1627376-21kworker/2:0+events23:20:152
154904299327918,3256cyclictest1563439-21kworker/2:1+events19:55:132
154904799317215,3152cyclictest1574470-21kworker/3:1+events20:30:133
154903499309613,3080cyclictest1600077-21kworker/0:0+events21:55:010
154903499300115,2983cyclictest1601969-21kworker/0:3+events22:00:020
154904299297511,2960cyclictest1550634-21kworker/2:3+events19:20:182
154904799294914,2931cyclictest1580998-21kworker/3:1+events20:55:183
154904799290612,2890cyclictest1553776-21kworker/3:1+events19:25:183
154904299286914,2851cyclictest1566829-21kworker/2:2+events20:06:132
154904299283313,2816cyclictest1557136-21kworker/2:0+events19:50:122
154904299282414,2807cyclictest1576207-21kworker/2:2+events20:45:002
154903499282313,2805cyclictest1577634-21kworker/0:1+events20:48:280
154903499282013,2798cyclictest1606631-21kworker/0:1+events22:10:150
154903499281513,2798cyclictest1580911-21kworker/0:0+events20:51:050
154904299281413,2797cyclictest1600168-21kworker/2:2+events21:50:212
154903499281413,2797cyclictest1582603-21kworker/0:2+events20:59:300
15490479928117,2800cyclictest1622878-21kworker/3:0+events23:14:583
154904799281113,2795cyclictest1601831-21kworker/3:1+events22:05:223
154904799281012,2794cyclictest1581087-21kworker/3:3+events20:51:293
154904799280713,2790cyclictest1587624-21kworker/3:0+events21:12:053
154904299280313,2786cyclictest1550634-21kworker/2:3+events19:25:412
154904799279613,2780cyclictest1641607-21kworker/3:1+events00:04:483
154904299279412,2778cyclictest1639565-21kworker/2:1+events23:52:342
154904799279313,2776cyclictest1641607-21kworker/3:1+events00:27:443
154903499278312,2767cyclictest1564947-21kworker/0:0+events20:02:180
154904299278213,2765cyclictest1594217-21kworker/2:2+events21:38:592
154904299278113,2764cyclictest1568617-21kworker/2:0+events20:20:582
154903499278013,2763cyclictest1638607-21kworker/0:2+events00:08:350
154903499278013,2763cyclictest1566591-21kworker/0:2+events20:12:190
154903499277713,2760cyclictest1621367-21kworker/0:1+events22:59:220
154903499277512,2759cyclictest1588768-21kworker/0:0+events21:16:140
154904299277213,2755cyclictest1576207-21kworker/2:2+events21:05:572
154903499277113,2754cyclictest1630839-21kworker/0:2+events23:27:040
154904299276913,2752cyclictest1590725-21kworker/2:0+events21:30:182
154904299276813,2751cyclictest1606722-21kworker/2:2+events22:17:522
154903499276813,2751cyclictest1545369-21kworker/0:1+events19:29:300
154903499276513,2748cyclictest1568292-21kworker/0:0+events20:24:040
154903499276413,2749cyclictest1611459-21kworker/0:1+events22:26:290
154903499276413,2747cyclictest1641880-21kworker/0:0+events00:03:390
154903499276213,2745cyclictest1638607-21kworker/0:2+events00:23:320
154903499276213,2745cyclictest1613057-21kworker/0:0+events22:32:110
154903499276211,2747cyclictest1601679-21kworker/0:2+events22:06:500
154903499276113,2744cyclictest1574368-21kworker/0:1+events20:30:580
154903499276112,2745cyclictest1552182-21kworker/0:0+events19:16:540
154904299275912,2743cyclictest1588826-21kworker/2:2+events21:21:382
154904299275911,2744cyclictest1648035-21kworker/2:2+events00:17:462
154903499275913,2742cyclictest1638607-21kworker/0:2+events00:12:240
154904799275712,2741cyclictest1587624-21kworker/3:0+events21:27:163
154904799275711,2742cyclictest1557135-21kworker/3:1+events20:00:503
15490429927577,2747cyclictest1568617-21kworker/2:0+events20:39:402
154903499275711,2742cyclictest1601679-21kworker/0:2+events22:16:220
154904799275611,2743cyclictest1645205-21kworker/3:3+events00:15:053
154903499275610,2742cyclictest1590695-21kworker/0:1+events21:41:410
154904299275413,2739cyclictest1557136-21kworker/2:0+events19:47:542
154904799275313,2736cyclictest1580998-21kworker/3:1+events21:02:113
154903499275313,2737cyclictest1651282-21kworker/0:0+events00:35:460
154903499275213,2735cyclictest1635349-21kworker/0:1+events23:46:250
154904799275013,2735cyclictest1560067-21kworker/3:2+events19:45:333
154904799275013,2733cyclictest1645205-21kworker/3:3+events00:13:333
154904799275013,2733cyclictest1612965-21kworker/3:2+events22:51:023
154903499274813,2731cyclictest1553805-21kworker/0:2+events19:24:320
154904799274413,2727cyclictest1638852-21kworker/3:2+events23:54:293
154904799274413,2727cyclictest1597004-21kworker/3:0+events21:51:533
154904799274113,2724cyclictest1598655-21kworker/3:2+events21:58:073
154904299274113,2724cyclictest1614451-21kworker/2:0+events22:32:572
15490479927409,2728cyclictest1637151-21kworker/3:0+events00:08:573
154904799274013,2723cyclictest1608146-21kworker/3:0+events22:34:033
154904799273912,2723cyclictest1572881-21kworker/3:0+events20:43:273
154904299273812,2722cyclictest1585533-21kworker/2:1+events21:02:562
154904799273713,2720cyclictest1622878-21kworker/3:0+events23:21:463
154904799273712,2721cyclictest1576092-21kworker/3:2+events20:49:343
15490429927369,2723cyclictest1617757-21kworker/2:2+events22:48:002
15490429927369,2723cyclictest1617757-21kworker/2:2+events22:47:592
154904799273313,2717cyclictest1597004-21kworker/3:0+events21:49:593
154904799273313,2717cyclictest1585440-21kworker/3:2+events21:07:273
154904799273112,2715cyclictest1622878-21kworker/3:0+events23:03:063
154903499272912,2713cyclictest1584467-21kworker/0:1+events21:10:570
15490349927259,2712cyclictest1590695-21kworker/0:1+events21:34:090
154904299272412,2708cyclictest1592342-21kworker/2:1+events21:26:072
154903499272313,2706cyclictest1590695-21kworker/0:1+events21:37:540
15490479927147,2703cyclictest1601831-21kworker/3:1+events22:11:023
154904299271213,2695cyclictest1587191-21kworker/2:0+events21:12:282
154904799270813,2691cyclictest1566712-21kworker/3:2+events20:07:463
154903499269213,2675cyclictest1558470-21kworker/0:0+events19:42:310
154903499269212,2676cyclictest1568292-21kworker/0:0+events20:39:170
15490429926797,2668cyclictest1568617-21kworker/2:0+events20:16:052
154903499266511,2650cyclictest1600077-21kworker/0:0+events21:49:350
154904799266413,2647cyclictest1595379-21kworker/3:1+events21:40:333
154904799264312,2627cyclictest1641607-21kworker/3:1+events00:31:113
154903499264113,2625cyclictest1625804-21kworker/0:1+events23:10:220
154903899263913,2622cyclictest1563348-21kworker/1:0+events19:55:351
154904299263012,2614cyclictest1577809-21kworker/2:1+events20:40:482
154903899262512,2611cyclictest1558679-21kworker/1:2+events19:45:101
154903499262113,2604cyclictest1560093-21kworker/0:1+events19:57:290
154903499261511,2600cyclictest1629042-21kworker/0:1+events23:17:390
154903499261312,2597cyclictest1545369-21kworker/0:1+events19:32:570
154903499260511,2591cyclictest1640244-21kworker/0:1+events23:58:200
154904299258713,2570cyclictest1616135-21kworker/2:1+events22:38:102
154904299258413,2568cyclictest1550634-21kworker/2:3+events19:33:422
154903499258212,2566cyclictest1558470-21kworker/0:0+events19:39:030
154903499258111,2566cyclictest1623064-21kworker/0:2+events23:03:300
154904299257012,2555cyclictest1625105-21kworker/2:1+events23:10:462
154904299256710,2553cyclictest1598508-21kworker/2:0+events21:44:412
154904799256612,2549cyclictest1595379-21kworker/3:1+events21:33:453
154904799256511,2550cyclictest1633898-21kworker/3:2+events23:36:133
154903499256512,2549cyclictest1580911-21kworker/0:0+events21:00:160
154903499256410,2552cyclictest1649636-21kworker/0:1+events00:25:010
154904799256111,2548cyclictest1651310-21kworker/3:2+events00:36:083
154904299256010,2547cyclictest1627376-21kworker/2:0+events23:15:442
154904299255913,2542cyclictest1639565-21kworker/2:1+events23:56:462
154904299255913,2542cyclictest1582272-21kworker/2:1+events20:53:002
154903499255611,2541cyclictest1651282-21kworker/0:0+events00:33:280
15490429925556,2545cyclictest1648035-21kworker/2:2+events00:21:132
154904299255012,2534cyclictest1608325-21kworker/2:0+events22:23:072
154904299254911,2534cyclictest1588826-21kworker/2:2+events21:17:002
154903499254812,2532cyclictest1572726-21kworker/0:2+events20:25:140
154904799254712,2531cyclictest1637151-21kworker/3:0+events23:55:383
154904299254712,2531cyclictest1639565-21kworker/2:1+events00:01:012
15490349925458,2533cyclictest1560093-21kworker/0:1+events20:06:590
154904299254412,2529cyclictest1628965-21kworker/2:2+events23:43:442
154904299254410,2530cyclictest1604258-21kworker/2:1+events22:07:582
154904799254310,2530cyclictest1587624-21kworker/3:0+events21:16:353
154904299254112,2525cyclictest1646431-21kworker/2:1+events00:12:462
154904799253710,2523cyclictest1635503-21kworker/3:1+events23:48:223
154903499253712,2521cyclictest1584467-21kworker/0:1+events21:06:180
154904299253612,2518cyclictest1617757-21kworker/2:2+events22:50:152
154903499253612,2520cyclictest1619769-21kworker/0:0+events23:07:420
154903499253611,2521cyclictest1601679-21kworker/0:2+events21:55:250
154904799253512,2519cyclictest1576092-21kworker/3:2+events20:38:123
154904299253512,2519cyclictest1598508-21kworker/2:0+events21:46:112
154904799253412,2519cyclictest1557135-21kworker/3:1+events19:44:243
154904799253412,2518cyclictest1630635-21kworker/3:1+events23:31:363
154904299253412,2519cyclictest1557136-21kworker/2:0+events19:37:072
15490349925344,2527cyclictest1568292-21kworker/0:0+events20:41:340
154903499253412,2519cyclictest1619769-21kworker/0:0+events23:21:010
154903499253412,2518cyclictest1614684-21kworker/0:2+events22:48:230
154903499253412,2518cyclictest1614684-21kworker/0:2+events22:48:220
154903499253212,2516cyclictest1590695-21kworker/0:1+events21:28:460
154903499253212,2516cyclictest1590695-21kworker/0:1+events21:24:580
154903499253212,2516cyclictest1561677-21kworker/0:2+events19:54:050
154903499253210,2518cyclictest1638607-21kworker/0:2+events00:15:280
15490429925317,2520cyclictest1611603-21kworker/2:2+events22:28:482
154903499253112,2515cyclictest1630839-21kworker/0:2+events23:36:350
154903499253112,2515cyclictest1546973-21kworker/0:2+events19:14:130
154903499253111,2516cyclictest1632521-21kworker/0:0+events23:34:420
154904799253012,2514cyclictest1595379-21kworker/3:1+events21:35:143
154903499253012,2515cyclictest1619769-21kworker/0:0+events22:50:370
154903499253012,2514cyclictest1614684-21kworker/0:2+events22:37:470
154904799252712,2511cyclictest1590508-21kworker/3:1+events21:23:513
154903499252712,2511cyclictest1561677-21kworker/0:2+events19:46:440
154904799252610,2512cyclictest1612965-21kworker/3:2+events22:55:333
154903899252413,2508cyclictest1603702-21kworker/1:0+events22:59:451
154904299252310,2509cyclictest1608325-21kworker/2:0+events22:13:422
154904799252210,2508cyclictest1557135-21kworker/3:1+events19:37:303
154904799252112,2506cyclictest1612965-21kworker/3:2+events22:42:433
154904799252112,2505cyclictest1624560-21kworker/3:1+events23:09:583
154904299252112,2505cyclictest1622969-21kworker/2:2+events23:07:192
154904299252112,2505cyclictest1576207-21kworker/2:2+events20:56:062
154904299252112,2504cyclictest1568617-21kworker/2:0+events20:34:442
154904299252012,2506cyclictest1632144-21kworker/2:1+events23:30:052
154904299252012,2504cyclictest1574397-21kworker/2:1+events20:28:392
15490479925179,2504cyclictest1545388-21kworker/3:2+events19:24:093
154904799251712,2501cyclictest1612965-21kworker/3:2+events22:46:053
154904799251712,2501cyclictest1612965-21kworker/3:2+events22:46:053
154904799251711,2502cyclictest1608146-21kworker/3:0+events22:35:353
154904799251612,2500cyclictest1630635-21kworker/3:1+events23:26:413
15490429925169,2503cyclictest1604258-21kworker/2:1+events22:01:112
154904299251512,2499cyclictest1628965-21kworker/2:2+events23:25:552
154904799251211,2499cyclictest1568322-21kworker/3:1+events20:10:033
15490429925119,2498cyclictest1614451-21kworker/2:0+events22:42:202
15490429925119,2498cyclictest1557136-21kworker/2:0+events19:41:432
154904299251112,2497cyclictest1600168-21kworker/2:2+events21:56:102
154904299251112,2496cyclictest1565090-21kworker/2:0+events20:03:522
154904799250812,2492cyclictest1635503-21kworker/3:1+events23:44:073
154904799250812,2492cyclictest1557135-21kworker/3:1+events19:51:243
154904799250712,2491cyclictest1648099-21kworker/3:0+events00:20:483
154904799250612,2490cyclictest1568322-21kworker/3:1+events20:17:563
154904299250610,2492cyclictest1641695-21kworker/2:0+events00:28:062
154904799250412,2489cyclictest1551172-21kworker/3:0+events19:19:553
154903899250311,2489cyclictest1593616-21kworker/1:2+events22:10:381
154904799250210,2488cyclictest1608146-21kworker/3:0+events22:29:113
15490479924989,2485cyclictest1569953-21kworker/3:2+events20:26:013
154903499249412,2478cyclictest1640244-21kworker/0:1+events23:54:530
154904299249310,2479cyclictest1621246-21kworker/2:1+events22:55:552
154904799249112,2476cyclictest1601831-21kworker/3:1+events22:21:173
154904299248410,2471cyclictest1622969-21kworker/2:2+events23:01:362
154904799248212,2468cyclictest1626188-21kworker/3:2+events23:15:223
154904799247212,2457cyclictest1557135-21kworker/3:1+events19:58:573
154904799246412,2448cyclictest1572881-21kworker/3:0+events20:23:183
154904299246412,2448cyclictest1628965-21kworker/2:2+events23:35:512
154903499244911,2434cyclictest1636975-21kworker/0:0+events23:44:290
154903499244811,2433cyclictest1601679-21kworker/0:2+events22:22:470
154904799244611,2431cyclictest1545388-21kworker/3:2+events19:13:493
154903499244510,2431cyclictest1568292-21kworker/0:0+events20:19:030
154904299244212,2426cyclictest1637481-21kworker/2:0+events23:49:082
154903899243612,2420cyclictest1616046-21kworker/1:2+events22:38:331
154904299243312,2418cyclictest1540377-21kworker/2:0+events19:14:362
154904799243010,2416cyclictest1601831-21kworker/3:1+events22:19:013
15490389924269,2413cyclictest1622937-21kworker/1:1+events23:34:191
154904299242512,2410cyclictest1641695-21kworker/2:0+events00:05:572
154903899242312,2407cyclictest1553927-21kworker/1:1+events19:29:071
154904299242212,2406cyclictest1568617-21kworker/2:0+events20:11:572
154903899241911,2405cyclictest1582511-21kworker/1:1+events21:25:431
154904299241811,2404cyclictest1550634-21kworker/2:3+events19:15:452
154904799241711,2403cyclictest1555467-21kworker/3:0+events19:34:063
154903899241610,2402cyclictest1636943-21kworker/1:2+events23:51:501
154904299240711,2393cyclictest1651343-21kworker/2:2+events00:30:482
154903899240010,2386cyclictest1610146-21kworker/1:1+events22:26:081
15490389923996,2389cyclictest1560428-21kworker/1:1+events20:08:541
154903899235012,2334cyclictest1644798-21kworker/1:2+events00:07:041
154903899234012,2324cyclictest1644798-21kworker/1:2+events00:16:151
154903899234012,2324cyclictest1560428-21kworker/1:1+events20:14:331
154903899233612,2321cyclictest1560428-21kworker/1:1+events19:52:091
154903899233512,2320cyclictest1542242-21kworker/1:0+events19:23:001
15490479923327,2321cyclictest1603532-21kworker/3:0+events22:02:413
154903899232512,2309cyclictest1633988-21kworker/1:0+events23:41:281
154903899232211,2307cyclictest1648006-21kworker/1:1+events00:28:291
154903899231312,2298cyclictest1542242-21kworker/1:0+events19:38:161
15490389922016,2192cyclictest1640123-21kworker/1:1+events00:04:041
154903899212612,2110cyclictest1571752-21kworker/1:2+events20:53:461
15490389917419,1731cyclictest1548308-21kworker/1:1+events19:10:011
15483832147104,24sleep30-21swapper/319:07:253
154903899145141,3cyclictest1558679-21kworker/1:2+pm19:45:011
15485212143112,26sleep00-21swapper/019:09:110
15472532142113,23sleep20-21swapper/219:05:042
15485802141111,25sleep10-21swapper/119:09:561
154903899252,20cyclictest0-21swapper/100:30:191
154903899236,14cyclictest1629823-21/usr/sbin/munin23:20:141
154903899217,11cyclictest1557435-21cat19:35:001
154903899215,4cyclictest1632233-21seq23:26:511
154903899207,10cyclictest1552742-21cat19:20:001
154903899206,5cyclictest1596056-21smartctl21:35:161
154903899205,3cyclictest1574351-21seq20:26:031
154903899203,16cyclictest0-21swapper/121:10:191
1549038992017,1cyclictest1629035-21seq23:16:381
1549038992015,3cyclictest1618386-21apt-key22:45:001
154903899199,7cyclictest1641967-21cron00:00:001
154903899198,5cyclictest1578123-21apt-get20:40:131
154903899192,14cyclictest740-21snmpd22:09:401
1549038991914,3cyclictest1621362-21taskset22:54:351
154903899190,9cyclictest1585829-21systemd-run21:05:001
154903899186,6cyclictest1604511-10ld22:00:161
154903899186,5cyclictest1609257-21ntpq22:15:151
154903899185,7cyclictest1576996-21strings20:35:171
154903899184,4cyclictest0-21swapper/100:40:011
1549038991812,4cyclictest740-21snmpd21:45:031
1549038991811,6cyclictest0-21swapper/122:30:181
154903899181,16cyclictest0-21swapper/122:20:201
154903899181,12cyclictest1645444-21apt-get00:10:131
154903899181,11cyclictest1574946-21apt-get20:30:121
1549038991810,6cyclictest1626544-21cstates23:10:141
154903899173,12cyclictest0-21swapper/123:05:211
154903899172,9cyclictest1598021-21smartctl21:40:191
154903899172,12cyclictest0-21swapper/121:20:011
1549038991714,2cyclictest0-21swapper/121:58:361
1549038991711,4cyclictest739-21runrttasks20:03:031
154903899167,6cyclictest1637999-21ntpq23:45:161
154903899167,6cyclictest1635662-21run-parts23:40:011
154903899167,6cyclictest1594250-21taskset21:30:111
154903899165,9cyclictest1591866-21cat21:20:201
1549038991613,2cyclictest0-21swapper/123:01:451
154903899161,11cyclictest1584221-21munin-run21:00:001
154903899161,10cyclictest1600578-21apt-get21:50:111
154903899160,5cyclictest1648623-21apt-get00:20:121
154903899157,6cyclictest1580308-21ld20:45:191
154903899150,7cyclictest1587518-21cat21:10:001
154903899150,3cyclictest1618494-21/usr/sbin/munin22:45:161
154903899150,3cyclictest1618494-21/usr/sbin/munin22:45:161
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional