You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-29 - 12:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Sun Mar 29, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
199029911436,57cyclictest0-21swapper/019:40:550
199029910437,50cyclictest0-21swapper/018:25:440
199029910437,50cyclictest0-21swapper/018:25:440
199029910433,56cyclictest0-21swapper/021:15:520
19910991034,93cyclictest0-21swapper/322:16:593
199029910232,10cyclictest0-21swapper/021:27:160
199099910131,12cyclictest0-21swapper/220:47:592
199029910138,47cyclictest0-21swapper/021:10:420
199029910138,47cyclictest0-21swapper/021:10:420
199029910135,10cyclictest1419-21runrttasks20:15:060
199029910133,7cyclictest12636-21diskmemload20:25:400
199029910133,7cyclictest12636-21diskmemload20:25:400
19910991005,27cyclictest0-21swapper/322:01:483
1991099984,45cyclictest0-21swapper/322:50:523
1991099983,46cyclictest11852-21crond22:40:233
19909999833,12cyclictest0-21swapper/219:55:442
19902999840,43cyclictest20005-21latency22:50:460
19902999834,49cyclictest0-21swapper/022:00:070
1991099974,48cyclictest1419-21runrttasks20:33:433
1991099974,48cyclictest1419-21runrttasks20:33:433
1990999973,37cyclictest0-21swapper/222:45:392
19902999732,50cyclictest0-21swapper/019:33:200
1991099964,28cyclictest0-21swapper/321:02:083
19909999533,12cyclictest0-21swapper/220:23:492
19902999519,67cyclictest30315-21kworker/0:020:30:410
19902999519,67cyclictest30315-21kworker/0:020:30:410
1991099944,48cyclictest0-21swapper/320:42:383
1991099944,44cyclictest0-21swapper/322:15:193
1991099944,27cyclictest0-21swapper/320:20:293
1991099943,45cyclictest2538-21rm21:36:103
1990999944,37cyclictest0-21swapper/221:50:402
1990999944,37cyclictest0-21swapper/221:50:402
1990299944,82cyclictest0-21swapper/020:00:460
1990299944,24cyclictest1419-21runrttasks22:27:530
1990999933,40cyclictest0-21swapper/219:41:082
1990299937,19cyclictest32611-21sh20:45:490
1990299934,24cyclictest3398-21telnet19:10:420
19902999332,11cyclictest0-21swapper/020:41:150
1990299933,24cyclictest25137-21ssh22:59:370
19902999324,14cyclictest0-21swapper/017:40:450
19902999324,14cyclictest0-21swapper/017:40:450
1991099925,26cyclictest0-21swapper/321:14:273
1991099925,26cyclictest0-21swapper/321:14:273
1991099924,81cyclictest0-21swapper/322:05:423
1991099924,26cyclictest0-21swapper/321:19:073
1990999924,37cyclictest0-21swapper/219:34:522
1990999923,42cyclictest24589-21ls22:10:372
1990299928,24cyclictest0-21swapper/022:10:540
1990299924,31cyclictest0-21swapper/020:20:500
1990299924,27cyclictest0-21swapper/022:00:440
19902999225,13cyclictest0-21swapper/020:20:160
19902999218,16cyclictest0-21swapper/022:18:570
19902999210,24cyclictest0-21swapper/022:24:390
1991099914,46cyclictest0-21swapper/321:58:113
1991099914,27cyclictest0-21swapper/321:08:433
1991099914,27cyclictest0-21swapper/321:08:433
1991099914,25cyclictest0-21swapper/321:30:493
1990999913,39cyclictest0-21swapper/219:40:302
1990999913,38cyclictest0-21swapper/221:20:582
1990999913,38cyclictest0-21swapper/218:15:342
1990299913,24cyclictest31147-21ssh21:30:570
19902999121,51cyclictest0-21swapper/021:00:230
19902999115,11cyclictest0-21swapper/022:45:470
1991099905,25cyclictest0-21swapper/319:38:053
1991099904,26cyclictest0-21swapper/318:31:073
1990299904,30cyclictest0-21swapper/021:35:440
1990299904,28cyclictest0-21swapper/021:41:210
1990299904,11cyclictest19515-21idleruntime-cro19:40:300
19902999026,13cyclictest0-21swapper/019:53:250
19902999026,13cyclictest0-21swapper/019:53:250
19902999018,10cyclictest121850irq/46-eth022:05:550
19902999016,14cyclictest0-21swapper/021:53:470
19902999016,14cyclictest0-21swapper/021:53:470
19902999016,13cyclictest0-21swapper/020:52:160
19902999016,11cyclictest307791ssh19:55:460
19902999012,21cyclictest0-21swapper/021:25:270
1991099894,42cyclictest0-21swapper/320:11:073
1990999894,36cyclictest0-21swapper/221:55:442
1990999893,40cyclictest12636-21diskmemload22:17:162
19909998914,7cyclictest0-21swapper/222:56:182
1990299895,26cyclictest0-21swapper/018:30:480
1990299895,13cyclictest0-21swapper/022:42:130
19902998918,10cyclictest121850irq/46-eth020:05:390
19909998838,9cyclictest1404-21head17:56:152
1990999883,43cyclictest0-21swapper/220:58:592
1990999883,40cyclictest0-21swapper/221:35:302
19909998829,10cyclictest11194-21grep19:25:482
19909998811,35cyclictest0-21swapper/222:30:572
19909998811,35cyclictest0-21swapper/222:30:572
1990299888,20cyclictest0-21swapper/021:45:470
1990299885,34cyclictest0-21swapper/019:48:110
1990299885,34cyclictest0-21swapper/019:48:110
1990299885,26cyclictest0-21swapper/022:30:510
1990299885,26cyclictest0-21swapper/022:30:510
1990299884,35cyclictest0-21swapper/021:05:420
1990299884,35cyclictest0-21swapper/021:05:420
1990299884,28cyclictest0-21swapper/022:35:470
19902998835,39cyclictest0-21swapper/018:15:500
1990999874,13cyclictest0-21swapper/220:27:322
1990999874,13cyclictest0-21swapper/220:27:322
19909998735,8cyclictest11715-21tr20:15:432
1990999873,43cyclictest0-21swapper/219:45:382
1990999873,43cyclictest0-21swapper/219:45:382
1990999873,42cyclictest0-21swapper/222:21:132
1990999873,40cyclictest0-21swapper/221:30:592
1990999873,39cyclictest0-21swapper/221:05:132
1990299874,28cyclictest0-21swapper/018:10:340
1990299873,26cyclictest0-21swapper/017:47:530
19902998721,12cyclictest0-21swapper/018:15:330
19902998716,13cyclictest0-21swapper/017:55:450
1991099867,43cyclictest0-21swapper/319:50:423
1991099867,43cyclictest0-21swapper/319:50:423
1990999868,72cyclictest0-21swapper/222:35:342
1990999864,42cyclictest0-21swapper/218:36:502
19909998631,9cyclictest25602-21tune2fs17:40:522
19909998631,9cyclictest25602-21tune2fs17:40:522
1990999863,76cyclictest0-21swapper/219:50:432
1990999863,76cyclictest0-21swapper/219:50:432
1990999863,38cyclictest0-21swapper/221:05:582
1990999863,38cyclictest0-21swapper/221:05:582
1990999863,36cyclictest0-21swapper/221:11:052
1990999863,36cyclictest0-21swapper/221:11:052
1990999862,46cyclictest5467-21ssh21:40:562
1990299865,13cyclictest0-21swapper/019:02:270
1991099855,8cyclictest7095-21munin-run21:45:253
1990999854,75cyclictest0-21swapper/222:05:442
1990999854,40cyclictest0-21swapper/222:43:592
1990999854,39cyclictest0-21swapper/222:04:532
1990999853,43cyclictest0-21swapper/220:08:592
1990999853,40cyclictest0-21swapper/220:38:532
1990299854,31cyclictest7784-21chrt19:19:490
1990299854,13cyclictest0-21swapper/020:35:470
1990299854,13cyclictest0-21swapper/018:50:450
19902998516,13cyclictest0-21swapper/021:03:040
1990999843,42cyclictest0-21swapper/220:43:412
1990999843,34cyclictest0-21swapper/218:05:452
1990999843,13cyclictest0-21swapper/220:30:422
1990999843,13cyclictest0-21swapper/220:30:422
1990299844,25cyclictest0-21swapper/019:09:500
1990299844,25cyclictest0-21swapper/019:09:500
1990299844,14cyclictest0-21swapper/017:35:480
1990999836,7cyclictest0-21swapper/217:40:352
1990999834,41cyclictest0-21swapper/218:50:442
1990999833,41cyclictest0-21swapper/222:26:162
1990999833,40cyclictest2398-21cat20:00:532
1990299833,73cyclictest0-21swapper/018:04:020
1991099825,27cyclictest0-21swapper/319:41:313
1991099824,45cyclictest25355-21munin-run23:00:223
1991099823,11cyclictest24599-21awk19:45:573
1991099823,11cyclictest24599-21awk19:45:573
1990999824,41cyclictest0-21swapper/221:49:332
1990999824,41cyclictest0-21swapper/221:17:132
1990999824,37cyclictest0-21swapper/220:50:492
1990999823,43cyclictest0-21swapper/218:55:562
1990299824,35cyclictest0-21swapper/019:30:310
1990299824,26cyclictest0-21swapper/018:40:520
1990999814,71cyclictest0-21swapper/220:10:432
1990999813,42cyclictest0-21swapper/218:20:452
1990999813,38cyclictest0-21swapper/221:25:552
1990299814,34cyclictest0-21swapper/018:55:500
1990299813,25cyclictest0-21swapper/018:21:050
1990299804,24cyclictest0-21swapper/018:46:030
19909997934,8cyclictest22148-21gltestperf18:40:512
1990999783,31cyclictest0-21swapper/222:50:442
1990299784,13cyclictest0-21swapper/017:32:050
1991099774,8cyclictest15243-21munin-run22:45:233
1990999773,41cyclictest0-21swapper/217:46:062
19909997715,30cyclictest29669-21munin-node17:50:462
1990299774,14cyclictest0-21swapper/019:20:580
1990999763,38cyclictest0-21swapper/218:45:442
1990299764,27cyclictest0-21swapper/017:51:030
19902997624,13cyclictest0-21swapper/018:35:570
1990999754,41cyclictest0-21swapper/218:18:262
19909997432,9cyclictest6442-21tune2fs19:15:502
1990999734,40cyclictest0-21swapper/217:31:482
1990999732,45cyclictest0-21swapper/218:00:532
1990999704,39cyclictest0-21swapper/218:33:192
1990999703,40cyclictest0-21swapper/219:04:202
19910996611,46cyclictest0-21swapper/320:45:393
1990799653,54cyclictest0-21swapper/120:35:211
1990799653,54cyclictest0-21swapper/120:35:211
19907996419,11cyclictest0-21swapper/119:33:581
102752643,12sleep10-21swapper/122:35:561
19907996332,23cyclictest7989-21munin-node20:10:571
248599620,4rtkit-daemon2484-21rtkit-daemon18:10:493
1991099614,49cyclictest0-21swapper/321:45:483
1991099603,49cyclictest0-21swapper/320:20:543
19907996022,12cyclictest18898-21processes22:00:521
98062594,12sleep10-21swapper/121:48:031
272202594,12sleep10-21swapper/122:15:081
1991099595,48cyclictest0-21swapper/322:45:383
1991099594,49cyclictest0-21swapper/321:26:593
1991099594,49cyclictest0-21swapper/321:20:573
19909995931,13cyclictest0-21swapper/219:22:502
64372586,45sleep30-21swapper/322:30:463
64372586,45sleep30-21swapper/322:30:463
1991099575,45cyclictest0-21swapper/320:50:583
1991099574,47cyclictest0-21swapper/322:22:453
1991099574,46cyclictest30972-21grep19:55:483
1991099574,45cyclictest1419-21runrttasks20:55:563
19907995738,11cyclictest2487-21cut18:00:481
1991099566,28cyclictest0-21swapper/322:26:453
1991099565,45cyclictest0-21swapper/318:40:433
1990799564,27cyclictest0-21swapper/121:50:571
1990799564,27cyclictest0-21swapper/121:50:571
1990799563,38cyclictest4375-21sed20:51:001
19907995618,20cyclictest27212-21sed19:50:451
19907995618,20cyclictest27212-21sed19:50:451
1991099553,44cyclictest0-21swapper/320:05:413
1990799555,15cyclictest0-21swapper/121:12:231
1990799555,15cyclictest0-21swapper/121:12:231
19907995525,14cyclictest0-21swapper/120:27:331
19907995525,14cyclictest0-21swapper/120:27:331
1991099544,28cyclictest0-21swapper/319:12:503
1990799545,15cyclictest0-21swapper/119:59:481
1990799545,12cyclictest0-21swapper/122:25:381
1990799544,26cyclictest0-21swapper/120:35:401
1990799544,13cyclictest1739-21forks20:00:461
62522533,44sleep16269-21diskstats19:15:481
1991099534,44cyclictest0-21swapper/320:04:543
1991099533,43cyclictest0-21swapper/320:25:443
1991099533,43cyclictest0-21swapper/320:25:443
1990999533,43cyclictest3075-21latency_hist19:10:322
1990999533,43cyclictest3075-21latency_hist19:10:322
1990799535,15cyclictest0-21swapper/122:23:071
1990799535,15cyclictest0-21swapper/120:57:591
1990799535,14cyclictest0-21swapper/122:43:101
1990799534,29cyclictest0-21swapper/119:36:351
19907995337,10cyclictest10840-21tr19:25:441
19907995320,18cyclictest13557-21gltestperf21:05:461
19907995320,18cyclictest13557-21gltestperf21:05:461
19907995316,13cyclictest0-21swapper/122:55:431
19907995310,25cyclictest0-21swapper/122:30:571
19907995310,25cyclictest0-21swapper/122:30:571
304332524,9sleep10-21swapper/122:19:351
256832523,42sleep10-21swapper/118:48:561
236102523,44sleep10-21swapper/122:09:151
1990799527,38cyclictest0-21swapper/119:43:241
1990799525,28cyclictest0-21swapper/118:50:551
1990799524,42cyclictest0-21swapper/120:05:551
1990799524,25cyclictest0-21swapper/121:21:191
1990799524,14cyclictest0-21swapper/122:50:531
1991099517,27cyclictest0-21swapper/317:40:353
1991099515,26cyclictest0-21swapper/320:37:273
1991099514,27cyclictest0-21swapper/318:50:263
1991099514,26cyclictest0-21swapper/319:02:273
1991099514,11cyclictest0-21swapper/318:55:593
1991099513,10cyclictest12234-21runrttasks21:50:553
1991099513,10cyclictest12234-21runrttasks21:50:553
1990799515,27cyclictest4006-21munin-node21:40:391
1990799514,22cyclictest0-21swapper/119:48:211
1990799514,22cyclictest0-21swapper/119:48:211
1990799514,12cyclictest17017-21python22:45:541
19907995135,10cyclictest30016-21unixbench_singl20:41:001
19907995129,14cyclictest0-21swapper/121:15:381
19907995121,10cyclictest31701-21sed19:00:521
26472503,7sleep12651-21ssh21:36:341
19910995021,11cyclictest0-21swapper/318:25:453
19910995021,11cyclictest0-21swapper/318:25:453
1990999504,41cyclictest0-21swapper/218:30:012
1990999504,41cyclictest0-21swapper/218:30:012
1990799506,28cyclictest0-21swapper/121:25:521
1990799505,27cyclictest0-21swapper/117:31:021
1990799505,14cyclictest0-21swapper/121:33:201
1990799505,14cyclictest0-21swapper/121:03:391
1990799504,28cyclictest0-21swapper/118:21:061
1990799503,21cyclictest14940-21gltestperf21:55:441
19907995020,13cyclictest0-21swapper/117:36:051
19907995020,12cyclictest0-21swapper/118:35:511
89682493,40sleep10-21swapper/118:14:091
1990999494,41cyclictest0-21swapper/219:11:012
1990799497,26cyclictest0-21swapper/117:42:071
1990799497,26cyclictest0-21swapper/117:42:071
1990799495,27cyclictest0-21swapper/119:06:501
1990799495,27cyclictest0-21swapper/119:06:501
1990799494,28cyclictest0-21swapper/118:55:461
1990799494,27cyclictest0-21swapper/117:46:071
1990799494,26cyclictest18421-21kworker/1:020:45:471
19907994920,12cyclictest0-21swapper/120:16:281
19907994919,13cyclictest0-21swapper/118:06:011
1991099484,38cyclictest0-21swapper/318:55:323
1991099484,28cyclictest0-21swapper/318:40:333
19910994831,11cyclictest5402-21gltestperf18:05:533
19910994818,12cyclictest0-21swapper/317:32:053
19910994818,11cyclictest10477-21munin-node19:26:063
1990799484,27cyclictest0-21swapper/119:10:591
1990799484,27cyclictest0-21swapper/118:30:511
1990799484,26cyclictest0-21swapper/119:20:581
1990799484,24cyclictest0-21swapper/120:24:471
113632483,11sleep10-21swapper/118:19:171
19910994731,10cyclictest1611-21tail19:05:513
19910994731,10cyclictest1611-21tail19:05:513
1991099472,10cyclictest0-21swapper/318:00:533
19910994719,12cyclictest0-21swapper/319:32:343
1990999473,37cyclictest0-21swapper/217:30:362
1990799474,26cyclictest0-21swapper/118:42:161
161022473,38sleep10-21swapper/118:28:321
161022473,38sleep10-21swapper/118:28:321
1991099465,24cyclictest7848-21munin-run19:20:313
1991099464,12cyclictest0-21swapper/317:55:363
1991099463,26cyclictest0-21swapper/318:15:483
1991099462,10cyclictest0-21swapper/319:20:413
1991099462,10cyclictest0-21swapper/317:59:503
19907994630,10cyclictest30499-21gltestperf17:50:541
1991099454,26cyclictest0-21swapper/318:21:063
1991099454,12cyclictest0-21swapper/317:41:013
1991099454,12cyclictest0-21swapper/317:41:013
1990799454,13cyclictest0-21swapper/117:55:531
248599440,26rtkit-daemon0-21swapper/017:30:360
19907994419,7cyclictest19988-21cat17:30:351
1991099434,15cyclictest0-21swapper/317:45:483
1991099424,32cyclictest0-21swapper/317:30:363
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional