You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-11 - 06:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Wed Mar 11, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
209719910510,27cyclictest19311-21cpuspeed_turbos23:07:310
209729910112,13cyclictest0-21swapper/121:02:521
209729910112,13cyclictest0-21swapper/121:02:521
209719910028,12cyclictest0-21swapper/020:37:460
1705521000,9sleep12097299cyclictest23:02:461
1705521000,9sleep12097299cyclictest23:02:461
20971999716,18cyclictest0-21swapper/021:01:050
2097299934,20cyclictest0-21swapper/117:47:301
2097199938,29cyclictest0-21swapper/018:12:410
2097299913,24cyclictest0-21swapper/119:49:081
2097199914,28cyclictest0-21swapper/021:07:220
2097199914,28cyclictest0-21swapper/021:07:220
2097299894,24cyclictest4902-21tune2fs21:57:371
2097299893,67cyclictest0-21swapper/121:17:221
20971998922,30cyclictest0-21swapper/019:50:570
20972998821,8cyclictest1287-21snmpd22:44:451
2097299873,77cyclictest0-21swapper/120:03:191
2097299853,74cyclictest3177-21cpuspeed_turbos21:07:351
20972998518,8cyclictest13494-21diskmemload22:11:101
2097299847,13cyclictest0-21swapper/121:46:541
2097299847,13cyclictest0-21swapper/121:46:541
2097299844,71cyclictest2817-21gltestperf20:17:431
2097299844,13cyclictest0-21swapper/122:48:191
20972998423,54cyclictest14478-21unixbench_multi18:38:011
20972998422,55cyclictest11247-21gltestperf18:32:471
2097299835,23cyclictest0-21swapper/123:00:411
2097299834,13cyclictest0-21swapper/120:42:421
2097299833,7cyclictest121850irq/46-eth020:40:371
2097299833,23cyclictest0-21swapper/120:07:591
20972998322,7cyclictest13678-21rm20:33:431
20972998319,42cyclictest0-21swapper/118:12:521
20972998317,8cyclictest1287-21snmpd21:56:371
20972998317,50cyclictest0-21swapper/122:37:341
20972998312,11cyclictest0-21swapper/122:30:411
2097299829,18cyclictest0-21swapper/123:12:461
2097299824,71cyclictest31599-21sed21:47:541
2097299824,24cyclictest0-21swapper/122:23:381
2097299824,24cyclictest0-21swapper/122:23:381
2097299824,24cyclictest0-21swapper/120:50:261
2097299824,21cyclictest18233-21diskstats22:17:351
2097299824,19cyclictest0-21swapper/118:49:551
2097299824,11cyclictest0-21swapper/121:19:171
2097299823,72cyclictest0-21swapper/122:55:291
2097299823,72cyclictest0-21swapper/122:12:311
2097299823,23cyclictest15347-21nscd23:07:351
20972998222,54cyclictest8438-21gltestperf22:02:391
20972998212,12cyclictest0-21swapper/122:32:321
2097299814,24cyclictest0-21swapper/121:40:531
2097299813,70cyclictest0-21swapper/121:34:401
2097299813,57cyclictest0-21swapper/120:22:521
20972998126,49cyclictest2631-21gltestperf19:22:451
20972998116,12cyclictest0-21swapper/120:12:451
2097299804,69cyclictest0-21swapper/121:22:401
2097299804,15cyclictest0-21swapper/118:24:281
2097299804,14cyclictest0-21swapper/120:27:341
20972998025,48cyclictest16236-21rm21:27:231
20972998023,50cyclictest8326-21cpuspeed_turbos18:27:421
20972998023,50cyclictest25352-21munin-node20:52:371
2097299794,67cyclictest25729-21munin-run17:57:291
2097299793,69cyclictest0-21swapper/120:57:481
20972997915,56cyclictest0-21swapper/118:12:291
2097299788,12cyclictest0-21swapper/119:54:381
2097299784,66cyclictest0-21swapper/120:02:101
2097299783,19cyclictest1419-21runrttasks18:06:581
20972997823,48cyclictest1419-21runrttasks19:18:071
2097299774,65cyclictest0-21swapper/118:17:501
2097299774,65cyclictest0-21swapper/118:17:501
2097299772,69cyclictest22391-21grep17:47:551
20972997713,12cyclictest0-21swapper/117:58:031
2097299763,67cyclictest0-21swapper/119:12:391
20972997624,46cyclictest28084-21if_err_eth019:07:481
20972997620,8cyclictest20570-21fschecks_count18:52:461
20972997613,12cyclictest0-21swapper/119:02:441
248599750,6rtkit-daemon2484-21rtkit-daemon18:29:563
2097299753,65cyclictest0-21swapper/119:37:481
20972997521,47cyclictest0-21swapper/119:42:361
20972997521,47cyclictest0-21swapper/119:42:361
20972997322,45cyclictest1419-21runrttasks18:57:321
20972997322,45cyclictest1419-21runrttasks18:57:321
2097299724,13cyclictest0-21swapper/119:32:361
20972997220,8cyclictest4805-21sshd19:27:441
20972997121,9cyclictest15247-21aten_r1power_fr18:42:391
248599700,5rtkit-daemon2484-21rtkit-daemon22:36:392
248342693,58sleep30-21swapper/323:15:153
61602677,53sleep00-21swapper/021:58:170
2097499655,53cyclictest0-21swapper/320:32:473
20974996519,25cyclictest0-21swapper/323:12:183
190792655,16sleep319230-21sed17:42:443
2097499644,53cyclictest0-21swapper/322:32:533
20973996433,14cyclictest0-21swapper/222:37:412
20973996423,22cyclictest1419-21runrttasks19:04:002
2097499635,51cyclictest9779-21grep19:37:433
2097499635,50cyclictest0-21swapper/322:37:313
2097499634,52cyclictest0-21swapper/320:12:403
2097499633,53cyclictest8173-21sh20:27:233
2097499633,52cyclictest30097-21fschecks_count19:12:443
20973996349,8cyclictest32650-21grep20:13:042
20971996330,12cyclictest0-21swapper/021:57:210
126412633,52sleep30-21swapper/322:57:333
109932630,14sleep02097199cyclictest18:32:440
2097499627,48cyclictest0-21swapper/322:00:443
2097499625,50cyclictest0-21swapper/322:07:333
2097499625,50cyclictest0-21swapper/318:42:483
2097499625,50cyclictest0-21swapper/318:22:593
2097499624,51cyclictest28486-21ls20:07:473
2097499624,51cyclictest0-21swapper/322:47:333
2097399623,12cyclictest0-21swapper/221:57:202
2097499615,49cyclictest0-21swapper/321:52:563
2097499614,50cyclictest0-21swapper/321:22:313
2097499614,49cyclictest17798-21python21:27:533
20974996119,26cyclictest20660-21if_eth021:32:443
2097399614,13cyclictest0-21swapper/222:47:502
20971996130,13cyclictest0-21swapper/022:22:140
147182613,50sleep20-21swapper/223:00:062
225102603,49sleep20-21swapper/222:22:502
225102603,49sleep20-21swapper/222:22:502
2097499605,48cyclictest0-21swapper/321:12:323
2097499605,48cyclictest0-21swapper/319:47:403
20974996018,35cyclictest9612-21munin-node21:17:313
20971996032,12cyclictest0-21swapper/017:58:020
20971996014,27cyclictest0-21swapper/021:32:220
68232593,10sleep00-21swapper/018:22:540
236902593,48sleep00-21swapper/018:57:560
236902593,48sleep00-21swapper/018:57:560
2097499595,47cyclictest26968-21yum-updatesd-he22:30:323
2097499594,48cyclictest0-21swapper/322:52:443
2097499594,48cyclictest0-21swapper/320:42:553
2097499594,48cyclictest0-21swapper/320:04:283
2097499594,48cyclictest0-21swapper/319:59:103
2097499594,47cyclictest0-21swapper/322:42:313
2097399594,12cyclictest0-21swapper/223:12:352
20973995934,8cyclictest21991-21ssh23:12:052
20973995931,12cyclictest0-21swapper/221:47:392
20973995930,13cyclictest0-21swapper/221:02:402
20973995930,13cyclictest0-21swapper/221:02:402
20973995927,13cyclictest0-21swapper/221:17:232
20973995923,30cyclictest17881-21grep19:52:452
2097199593,36cyclictest319-21cat22:37:520
245792584,48sleep00-21swapper/020:02:410
2097499585,47cyclictest0-21swapper/321:07:413
2097499584,48cyclictest31177-21ssh21:01:123
2097499584,47cyclictest16294-21ntp_states20:37:503
2097499584,47cyclictest1419-21runrttasks19:56:303
2097499584,47cyclictest10837-21yum-updatesd-he20:30:423
2097499584,46cyclictest24423-21processes21:37:483
20973995841,10cyclictest2974-21grep19:22:502
20973995832,8cyclictest29005-21ssh20:57:392
20973995827,12cyclictest0-21swapper/220:22:442
20971995829,10cyclictest14719-21df_abs22:12:350
20971995823,14cyclictest0-21swapper/022:52:300
204452587,11sleep00-21swapper/020:43:480
29932578,41sleep00-21swapper/022:42:390
248599570,4rtkit-daemon2484-21rtkit-daemon20:44:282
2097499575,46cyclictest0-21swapper/320:53:503
2097499575,46cyclictest0-21swapper/320:21:503
2097499575,45cyclictest15610-21ntp_states22:12:483
2097499574,48cyclictest0-21swapper/322:04:553
2097499574,47cyclictest22159-21load22:22:423
2097499574,47cyclictest22159-21load22:22:423
2097499574,47cyclictest0-21swapper/322:22:023
2097499574,47cyclictest0-21swapper/321:42:583
2097499574,47cyclictest0-21swapper/321:42:583
2097499574,46cyclictest0-21swapper/321:47:543
2097499574,46cyclictest0-21swapper/320:47:513
2097399574,12cyclictest0-21swapper/220:47:422
20973995728,13cyclictest0-21swapper/219:50:442
20973995727,15cyclictest0-21swapper/222:12:502
2097199574,33cyclictest0-21swapper/021:37:530
20971995714,24cyclictest0-21swapper/020:10:390
145082574,10sleep00-21swapper/022:59:200
89882563,45sleep20-21swapper/219:37:362
248599560,5rtkit-daemon2484-21rtkit-daemon21:30:422
20973995629,13cyclictest0-21swapper/222:27:292
20973995629,12cyclictest0-21swapper/221:35:512
20973995628,12cyclictest0-21swapper/220:12:242
20973995627,13cyclictest0-21swapper/220:04:472
20973995610,29cyclictest0-21swapper/219:42:372
20973995610,29cyclictest0-21swapper/219:42:372
2097199564,28cyclictest0-21swapper/019:12:270
2097199564,26cyclictest0-21swapper/019:58:420
2097199563,38cyclictest0-21swapper/022:24:100
2097199563,38cyclictest0-21swapper/022:24:100
20971995627,10cyclictest19076-21kworker/0:223:12:380
20971995625,13cyclictest0-21swapper/020:35:490
20971995624,14cyclictest0-21swapper/021:22:470
20971995624,13cyclictest0-21swapper/020:17:490
20971995623,12cyclictest0-21swapper/020:27:530
20971995618,22cyclictest15-21rcuc/020:12:520
175932563,8sleep317672-21munin-node18:47:403
281262553,12sleep20-21swapper/219:07:502
248599550,5rtkit-daemon2484-21rtkit-daemon20:30:372
248599550,5rtkit-daemon2484-21rtkit-daemon19:30:462
20973995528,12cyclictest0-21swapper/222:56:512
20973995524,25cyclictest0-21swapper/221:17:402
2097199555,30cyclictest0-21swapper/019:27:490
2097199553,37cyclictest0-21swapper/018:39:040
20971995527,12cyclictest0-21swapper/022:32:330
20971995527,12cyclictest0-21swapper/020:52:480
20971995526,14cyclictest0-21swapper/022:47:310
20971995524,14cyclictest0-21swapper/022:07:370
20971995522,14cyclictest0-21swapper/019:22:470
114582554,11sleep00-21swapper/021:17:580
248599540,5rtkit-daemon2484-21rtkit-daemon21:57:412
248599540,5rtkit-daemon2484-21rtkit-daemon21:37:342
248599540,5rtkit-daemon2484-21rtkit-daemon18:22:572
244562542,10sleep20-21swapper/219:02:062
244562542,10sleep20-21swapper/219:02:062
20973995439,9cyclictest13379-21unixbench_multi20:32:562
20973995427,12cyclictest0-21swapper/221:43:442
20973995427,12cyclictest0-21swapper/221:43:442
20971995436,13cyclictest0-21swapper/021:12:330
20971995427,11cyclictest21823-21chrt20:47:340
20971995419,8cyclictest9789-21cut19:37:430
20971995414,22cyclictest26968-21yum-updatesd-he22:30:360
268692535,10sleep00-21swapper/019:07:230
248599530,5rtkit-daemon2484-21rtkit-daemon18:27:562
248599530,5rtkit-daemon2484-21rtkit-daemon18:12:572
248599530,5rtkit-daemon2484-21rtkit-daemon17:52:432
2097499535,29cyclictest0-21swapper/321:07:233
2097499535,29cyclictest0-21swapper/321:07:233
2097399533,31cyclictest0-21swapper/222:45:192
2097399533,11cyclictest0-21swapper/218:42:282
20973995326,12cyclictest0-21swapper/222:05:212
20973995326,12cyclictest0-21swapper/221:07:402
2097199539,26cyclictest0-21swapper/021:32:470
2097199536,28cyclictest0-21swapper/020:26:270
2097199535,28cyclictest0-21swapper/018:56:430
20971995329,9cyclictest8470-21http_loadtime22:02:400
20971995320,9cyclictest2910-21taskset21:07:320
248599520,5rtkit-daemon2484-21rtkit-daemon20:37:442
248599520,5rtkit-daemon2484-21rtkit-daemon20:19:292
248599520,5rtkit-daemon2484-21rtkit-daemon18:07:502
20974995235,10cyclictest1563-21gltestperf18:12:493
20973995237,9cyclictest4144-21wc18:17:492
20973995237,9cyclictest4144-21wc18:17:492
20973995225,12cyclictest0-21swapper/218:53:002
2097199527,28cyclictest0-21swapper/021:48:570
2097199525,28cyclictest0-21swapper/021:42:450
2097199525,28cyclictest0-21swapper/021:42:450
2097199525,27cyclictest0-21swapper/018:42:540
2097199524,28cyclictest0-21swapper/019:42:450
2097199524,28cyclictest0-21swapper/019:42:450
2097199524,28cyclictest0-21swapper/019:17:410
2097199524,26cyclictest0-21swapper/019:54:450
248599510,6rtkit-daemon2484-21rtkit-daemon22:17:322
248599510,5rtkit-daemon2484-21rtkit-daemon19:32:392
248599510,5rtkit-daemon2484-21rtkit-daemon18:02:422
20973995136,9cyclictest21793-21uniq17:47:482
20973995132,7cyclictest15780-21rm21:26:302
20973995123,14cyclictest0-21swapper/220:52:392
2097199514,29cyclictest0-21swapper/018:03:580
2097199514,28cyclictest0-21swapper/019:12:380
2097199514,28cyclictest0-21swapper/018:47:470
2097199514,27cyclictest16122-21df_abs23:02:320
2097199514,27cyclictest16122-21df_abs23:02:320
2097199514,27cyclictest0-21swapper/018:27:500
2097199514,27cyclictest0-21swapper/017:52:300
305202502,10sleep20-21swapper/219:12:502
248599500,5rtkit-daemon2484-21rtkit-daemon22:08:402
2097499505,26cyclictest0-21swapper/318:17:403
2097499505,26cyclictest0-21swapper/318:17:403
2097499504,31cyclictest0-21swapper/323:04:483
2097499504,31cyclictest0-21swapper/323:04:483
2097499504,27cyclictest0-21swapper/318:37:403
20974995016,12cyclictest0-21swapper/319:17:393
2097199504,28cyclictest0-21swapper/018:17:470
2097199504,28cyclictest0-21swapper/018:17:470
2097199504,28cyclictest0-21swapper/018:07:440
20971995018,13cyclictest0-21swapper/017:52:510
163022503,39sleep20-21swapper/223:02:362
163022503,39sleep20-21swapper/223:02:362
248599490,5rtkit-daemon2484-21rtkit-daemon20:01:452
2097499494,28cyclictest0-21swapper/319:32:583
2097499494,27cyclictest0-21swapper/318:36:453
2097499493,27cyclictest0-21swapper/317:47:513
20974994917,12cyclictest0-21swapper/319:24:103
20973994933,10cyclictest32558-21cut19:17:462
2097199494,38cyclictest0-21swapper/019:32:430
170312492,10sleep20-21swapper/218:43:402
248599480,5rtkit-daemon2484-21rtkit-daemon17:58:502
2097499484,26cyclictest0-21swapper/319:07:483
2097499484,25cyclictest0-21swapper/318:54:063
2097499483,24cyclictest26991-21irqstats17:57:523
2097399482,41cyclictest0-21swapper/218:34:462
2097499474,37cyclictest0-21swapper/318:57:573
2097499474,37cyclictest0-21swapper/318:57:573
2097499472,9cyclictest0-21swapper/318:09:193
20974994719,21cyclictest0-21swapper/319:02:393
61562462,38sleep30-21swapper/319:30:283
2097499463,24cyclictest23572-21munin-node17:52:553
2097199464,25cyclictest0-21swapper/017:47:300
196522462,10sleep20-21swapper/218:51:462
132712462,38sleep30-21swapper/319:44:383
132712462,38sleep30-21swapper/319:44:383
2097499443,22cyclictest0-21swapper/318:03:583
248599430,4rtkit-daemon2484-21rtkit-daemon17:46:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional