You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-11 - 16:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Sun Jan 11, 2026 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2485991280,5rtkit-daemon2484-21rtkit-daemon08:54:522
1435221180,3sleep014354-21cat08:37:230
2242921100,5sleep222431-21grep09:37:392
2693621030,4sleep226937-21cat11:22:162
238709910311,24cyclictest16032-21latency09:27:462
23870991015,40cyclictest1419-21runrttasks08:44:482
2387099995,25cyclictest21096-21ssh11:12:322
2386499994,24cyclictest0-21swapper/008:52:410
2387099985,27cyclictest0-21swapper/210:32:482
2387099984,22cyclictest4670-21crond11:37:152
2386499974,26cyclictest0-21swapper/010:57:170
2387099964,37cyclictest0-21swapper/210:07:322
2387099964,27cyclictest0-21swapper/209:22:382
2386499963,25cyclictest0-21swapper/012:01:030
2387099954,25cyclictest0-21swapper/209:32:312
23870999528,11cyclictest11579-21latency10:57:412
23870999528,11cyclictest11579-21latency10:57:412
2387099945,29cyclictest0-21swapper/209:42:482
2387099945,28cyclictest0-21swapper/211:44:482
2387099944,42cyclictest0-21swapper/210:37:432
23864999419,16cyclictest0-21swapper/011:17:480
2387099935,81cyclictest0-21swapper/211:37:332
2387099935,81cyclictest0-21swapper/211:37:332
2387099935,28cyclictest0-21swapper/209:57:372
2387099935,13cyclictest0-21swapper/209:21:352
2387099934,12cyclictest22857-21aten_r1power_vo10:27:302
2386499934,81cyclictest0-21swapper/009:46:280
2386499934,29cyclictest0-21swapper/009:22:200
2386499934,27cyclictest0-21swapper/010:12:530
2386499934,27cyclictest0-21swapper/010:12:530
2387199925,78cyclictest0-21swapper/311:41:163
2387199925,78cyclictest0-21swapper/311:41:163
2387099925,24cyclictest14124-21smartctl11:52:312
2387099924,26cyclictest0-21swapper/211:31:212
2387099924,25cyclictest0-21swapper/211:08:512
2387099924,13cyclictest0-21swapper/211:27:122
23870999231,11cyclictest26235-21crond06:47:272
23870999217,13cyclictest0-21swapper/209:52:462
23870999217,10cyclictest4198-21ssh09:10:562
2386499923,28cyclictest0-21swapper/009:02:420
23864999219,12cyclictest0-21swapper/009:10:260
2387199912,82cyclictest0-21swapper/311:11:503
2387099915,27cyclictest0-21swapper/212:07:282
23870999121,13cyclictest0-21swapper/211:03:482
2386499919,9cyclictest221561ssh09:37:360
2386499914,80cyclictest0-21swapper/010:42:160
2386499914,79cyclictest0-21swapper/010:57:370
2386499914,79cyclictest0-21swapper/010:57:370
2386499914,79cyclictest0-21swapper/009:57:350
2386499914,78cyclictest0-21swapper/008:07:500
2386499914,30cyclictest0-21swapper/009:23:180
2386499914,27cyclictest0-21swapper/011:04:410
2386499914,27cyclictest0-21swapper/009:12:330
2386499914,25cyclictest0-21swapper/010:05:340
23864999117,13cyclictest0-21swapper/011:31:580
23864999116,10cyclictest10019-21fschecks_count10:07:360
2387199903,80cyclictest3522-21runrttasks10:47:153
2387099905,26cyclictest0-21swapper/212:04:342
2387099905,25cyclictest0-21swapper/210:48:002
2387099904,15cyclictest0-21swapper/210:17:412
2387099904,14cyclictest0-21swapper/208:59:032
2387099903,38cyclictest0-21swapper/210:42:342
2386499907,23cyclictest0-21swapper/006:52:380
2386499904,79cyclictest0-21swapper/008:37:560
2386499904,70cyclictest0-21swapper/010:22:580
2386499904,28cyclictest0-21swapper/010:27:510
2386499904,27cyclictest0-21swapper/010:17:370
2386499904,26cyclictest0-21swapper/009:48:420
2386499904,25cyclictest0-21swapper/011:15:320
2386499903,28cyclictest0-21swapper/011:51:410
2387099895,37cyclictest0-21swapper/207:32:362
2387099895,37cyclictest0-21swapper/207:32:362
2387099895,34cyclictest0-21swapper/207:47:562
2387099895,27cyclictest0-21swapper/209:16:312
2387099893,26cyclictest0-21swapper/208:48:582
2386499895,77cyclictest0-21swapper/011:07:230
2386499894,78cyclictest0-21swapper/011:42:300
2386499894,26cyclictest0-21swapper/012:09:230
2387099884,28cyclictest0-21swapper/207:27:362
2387099884,27cyclictest0-21swapper/208:17:412
2387099884,27cyclictest0-21swapper/208:17:412
2387099884,23cyclictest21318-21yum-updatesd-he10:23:212
2387099884,22cyclictest16605-21diskmemload08:42:222
2387099884,13cyclictest0-21swapper/207:12:452
2387099883,27cyclictest0-21swapper/209:02:382
2386499884,76cyclictest0-21swapper/009:54:430
2386499884,26cyclictest0-21swapper/011:32:480
2386499883,26cyclictest0-21swapper/007:12:440
23864998810,24cyclictest0-21swapper/011:22:360
2387199873,76cyclictest20744-21gltestperf12:02:333
2387099875,28cyclictest0-21swapper/206:52:482
2387099875,26cyclictest0-21swapper/207:52:372
2387099875,11cyclictest15522-21taskset10:16:252
2387099875,11cyclictest15522-21taskset10:16:252
23870998725,14cyclictest0-21swapper/207:22:262
2386499874,76cyclictest0-21swapper/008:48:480
2386499874,76cyclictest0-21swapper/008:42:360
2386499874,75cyclictest0-21swapper/010:45:050
2386499873,76cyclictest0-21swapper/010:32:280
23864998720,13cyclictest0-21swapper/011:56:090
2387199864,75cyclictest0-21swapper/312:01:203
2387199864,75cyclictest0-21swapper/309:16:283
2387199864,66cyclictest0-21swapper/311:19:593
2387199863,76cyclictest8315-21memory10:52:413
2387199863,76cyclictest0-21swapper/312:10:123
2387199863,75cyclictest9013-21munin-node09:17:413
2387199863,74cyclictest0-21swapper/309:27:343
2387199863,67cyclictest5505-21ssh10:01:263
2387199863,64cyclictest0-21swapper/311:01:293
2387199863,64cyclictest0-21swapper/311:01:293
2387199863,42cyclictest0-21swapper/309:55:533
2387099865,14cyclictest0-21swapper/210:02:212
2387099864,29cyclictest0-21swapper/211:49:202
2387099864,13cyclictest0-21swapper/212:00:492
23870998632,11cyclictest8401-21cat08:22:472
23870998617,14cyclictest0-21swapper/207:06:122
2386499864,75cyclictest0-21swapper/009:27:550
2386499864,26cyclictest0-21swapper/007:47:420
2386499864,13cyclictest0-21swapper/009:02:210
2386499864,12cyclictest0-21swapper/006:47:290
2386499864,12cyclictest0-21swapper/006:47:290
2387199854,65cyclictest0-21swapper/309:01:133
2387199853,75cyclictest0-21swapper/311:52:343
2387199853,74cyclictest279901rm10:33:013
2387199853,74cyclictest0-21swapper/306:57:443
2387199853,72cyclictest0-21swapper/308:55:043
2387099855,15cyclictest0-21swapper/207:07:532
2387099854,28cyclictest0-21swapper/208:27:532
2387099854,27cyclictest0-21swapper/209:51:562
23870998529,13cyclictest7239-21aten2.4-expect10:52:282
2386499854,74cyclictest0-21swapper/008:17:530
2386499854,74cyclictest0-21swapper/008:17:530
2386499854,23cyclictest0-21swapper/012:02:490
2386499853,75cyclictest0-21swapper/007:42:370
2386499853,17cyclictest0-21swapper/011:40:360
2386499853,17cyclictest0-21swapper/011:40:360
2387199844,73cyclictest0-21swapper/310:27:353
2387199844,73cyclictest0-21swapper/309:47:393
2387199844,72cyclictest0-21swapper/309:33:393
2387199843,73cyclictest93361ssh10:07:263
2387199843,73cyclictest6954-21ssh10:02:393
2387199843,62cyclictest0-21swapper/308:37:223
2387099844,23cyclictest0-21swapper/206:57:402
2386499844,72cyclictest0-21swapper/007:27:380
2386499844,26cyclictest0-21swapper/010:47:530
2386499843,25cyclictest0-21swapper/009:33:020
2387199834,60cyclictest0-21swapper/310:23:023
2387199834,58cyclictest0-21swapper/309:24:543
2387199833,72cyclictest21224-21iostat_ios08:47:453
2387199833,61cyclictest0-21swapper/309:43:323
2387099834,29cyclictest0-21swapper/208:02:412
2387099833,24cyclictest0-21swapper/208:12:362
2386499835,28cyclictest0-21swapper/007:52:470
2387199825,70cyclictest0-21swapper/310:12:313
2387199825,70cyclictest0-21swapper/310:12:313
2387199824,71cyclictest0-21swapper/309:40:343
2387199824,70cyclictest0-21swapper/311:26:233
2387199824,70cyclictest0-21swapper/307:18:413
2387199823,72cyclictest1287-21snmpd09:06:323
2387199823,72cyclictest0-21swapper/308:07:423
2387199823,70cyclictest1419-21runrttasks08:42:353
2387099825,28cyclictest0-21swapper/207:42:562
2387099825,10cyclictest1649-21unixbench-2d08:07:582
23864998234,42cyclictest0-21swapper/006:57:450
2386499823,29cyclictest0-21swapper/007:36:170
2386499823,29cyclictest0-21swapper/007:36:170
2387199814,70cyclictest0-21swapper/311:27:503
2387199814,70cyclictest0-21swapper/308:22:413
2386499814,70cyclictest0-21swapper/007:41:590
2386499814,68cyclictest0-21swapper/007:22:370
2387199808,56cyclictest121850irq/46-eth010:47:363
2387199804,69cyclictest0-21swapper/311:45:383
2387199804,69cyclictest0-21swapper/307:17:263
2387199804,68cyclictest0-21swapper/307:42:433
2387199803,70cyclictest26772-21tr06:47:433
2387199803,70cyclictest26772-21tr06:47:433
2387199803,70cyclictest0-21swapper/311:32:383
2387199803,70cyclictest0-21swapper/310:18:343
2387199803,70cyclictest0-21swapper/309:07:523
2387199803,52cyclictest16605-21diskmemload10:37:293
2387199803,47cyclictest0-21swapper/311:02:373
2386499804,69cyclictest0-21swapper/006:42:530
23864998031,42cyclictest2768-21find07:02:560
2387199794,68cyclictest0-21swapper/311:16:523
2387199793,69cyclictest29593-21fschecks_time06:52:443
2387199793,69cyclictest2714-21cpu08:12:363
2387199793,69cyclictest0-21swapper/306:42:423
23870997925,13cyclictest0-21swapper/207:22:472
2386499794,68cyclictest0-21swapper/008:27:580
23864997922,8cyclictest1419-21runrttasks08:15:120
2387199784,66cyclictest0-21swapper/308:27:443
2387199783,67cyclictest11773-21ssh11:47:583
2386499783,24cyclictest1287-21snmpd07:08:030
2387199764,55cyclictest0-21swapper/307:51:193
2387199763,66cyclictest29393-21unixbench_singl07:58:003
2387199763,65cyclictest10893-21munin-node07:22:443
2386499763,30cyclictest0-21swapper/007:57:370
2386499754,13cyclictest0-21swapper/007:17:380
2387199744,64cyclictest0-21swapper/308:41:273
2387199744,51cyclictest4881-21munin-node08:17:343
2387199744,51cyclictest4881-21munin-node08:17:343
2387199742,47cyclictest0-21swapper/307:07:373
23864997421,7cyclictest23844-21latency_hist06:42:270
2387199724,46cyclictest1287-21snmpd07:54:513
2387199723,62cyclictest20233-21munin-run07:42:253
2386499724,11cyclictest0-21swapper/008:22:400
2387199719,40cyclictest32364-21cat08:07:253
2387199716,43cyclictest121850irq/46-eth007:27:393
2387199713,60cyclictest1791-21sed07:02:423
2386499693,30cyclictest0-21swapper/008:02:450
2387199684,57cyclictest16205-21munin-node07:32:413
2387199684,57cyclictest16205-21munin-node07:32:413
2387199674,56cyclictest0-21swapper/306:42:283
248599660,6rtkit-daemon2484-21rtkit-daemon08:02:242
2386999654,22cyclictest0-21swapper/109:41:381
23869996420,27cyclictest0-21swapper/110:26:481
248599630,10rtkit-daemon0-21swapper/110:55:401
2386999635,48cyclictest0-21swapper/111:22:361
2386999635,31cyclictest0-21swapper/109:22:311
2386999625,31cyclictest0-21swapper/111:32:161
2386999624,38cyclictest0-21swapper/110:11:021
23869996217,24cyclictest0-21swapper/109:11:581
23869996212,26cyclictest1419-21runrttasks06:52:281
23869996212,26cyclictest1419-21runrttasks06:52:281
248599610,3rtkit-daemon0-21swapper/110:35:551
248599610,2rtkit-daemon0-21swapper/111:00:471
248599610,2rtkit-daemon0-21swapper/111:00:471
2387099614,15cyclictest0-21swapper/207:37:412
2386999614,35cyclictest0-21swapper/112:05:201
2386999613,37cyclictest0-21swapper/110:48:311
23869996118,23cyclictest0-21swapper/112:09:431
248599600,2rtkit-daemon0-21swapper/111:45:001
2387099595,28cyclictest0-21swapper/206:47:432
2387099595,28cyclictest0-21swapper/206:47:432
2386999594,37cyclictest0-21swapper/108:52:301
23869995916,22cyclictest0-21swapper/108:44:481
248599580,2rtkit-daemon0-21swapper/111:05:171
2386999583,49cyclictest0-21swapper/109:14:141
23869995738,12cyclictest9084-21gltestperf09:17:411
150652573,11sleep10-21swapper/108:37:411
23869995636,12cyclictest1559-21cut07:02:401
23869995618,28cyclictest22818-21tail10:27:291
248599550,5rtkit-daemon2484-21rtkit-daemon11:15:161
248599550,4rtkit-daemon2484-21rtkit-daemon11:12:171
23869995511,27cyclictest0-21swapper/111:59:501
178072553,46sleep117900-21users10:17:541
147112553,45sleep10-21swapper/111:52:431
23869995436,10cyclictest10453-21gltestperf08:27:421
23869995434,12cyclictest7261-21needreboot10:02:431
23869995422,14cyclictest0-21swapper/107:37:431
23869995419,13cyclictest0-21swapper/109:58:541
23869995320,14cyclictest0-21swapper/111:50:391
23869995320,13cyclictest0-21swapper/111:19:441
271432523,11sleep10-21swapper/107:54:161
248599520,5rtkit-daemon2484-21rtkit-daemon10:41:101
248599520,4rtkit-daemon2484-21rtkit-daemon06:42:272
2386999524,32cyclictest0-21swapper/110:44:541
2386999524,28cyclictest0-21swapper/111:36:031
2386999524,27cyclictest0-21swapper/107:27:281
23869995229,15cyclictest12099-21aten_r1power_en08:32:341
23869995219,14cyclictest0-21swapper/109:45:521
255402513,40sleep10-21swapper/106:43:031
2386999519,26cyclictest0-21swapper/109:47:311
2386999515,40cyclictest0-21swapper/107:21:141
2386999514,28cyclictest0-21swapper/109:55:521
2386999514,28cyclictest0-21swapper/109:35:161
2386999514,28cyclictest0-21swapper/106:57:551
2386999514,27cyclictest0-21swapper/107:33:001
2386999514,27cyclictest0-21swapper/107:33:001
2386999514,27cyclictest0-21swapper/107:27:251
2386999513,20cyclictest0-21swapper/110:16:081
2386999513,20cyclictest0-21swapper/110:16:081
2386999505,26cyclictest0-21swapper/108:50:521
2386999504,26cyclictest0-21swapper/109:06:331
23869995020,12cyclictest0-21swapper/108:57:361
82492493,12sleep10-21swapper/107:17:161
2386999495,26cyclictest0-21swapper/111:40:331
2386999495,26cyclictest0-21swapper/111:40:331
2386999494,27cyclictest0-21swapper/109:31:461
2387099484,24cyclictest0-21swapper/208:32:352
2386999485,26cyclictest0-21swapper/108:17:231
23869994818,12cyclictest0-21swapper/107:07:511
23869994812,22cyclictest30188-21cpu08:02:371
296402473,12sleep10-21swapper/108:00:451
2386999475,25cyclictest0-21swapper/107:46:181
2386999474,26cyclictest0-21swapper/108:11:231
2386999474,26cyclictest0-21swapper/107:47:531
23869994628,10cyclictest29673-21gltestperf06:52:451
2386999454,33cyclictest0-21swapper/108:17:511
2386999454,33cyclictest0-21swapper/108:17:511
23869994532,8cyclictest8189-21hwlatdetect08:22:431
2386999414,16cyclictest0-21swapper/106:42:271
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional