You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-11 - 10:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Mon May 11, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25449991023,55cyclictest0-21swapper/120:00:411
25449999943,12cyclictest12224-21crond17:30:121
2545199973,66cyclictest0-21swapper/321:35:143
25450999738,14cyclictest0-21swapper/220:15:572
25450999633,7cyclictest9074-21ssh20:58:302
2545199952,61cyclictest0-21swapper/320:21:353
2545199952,61cyclictest0-21swapper/320:21:353
25450999430,13cyclictest0-21swapper/219:18:492
2545099934,53cyclictest0-21swapper/219:36:062
2545099934,53cyclictest0-21swapper/219:11:072
2545099933,53cyclictest0-21swapper/217:50:132
2544799933,13cyclictest0-21swapper/018:58:000
2544799933,13cyclictest0-21swapper/018:58:000
25450999231,13cyclictest0-21swapper/221:21:072
25450999231,13cyclictest0-21swapper/219:02:132
2545099922,53cyclictest0-21swapper/221:44:352
2545099922,53cyclictest0-21swapper/221:44:352
25447999220,9cyclictest269321telnet18:00:220
25447999220,51cyclictest0-21swapper/019:55:280
2545099914,50cyclictest0-21swapper/220:50:412
2545099913,53cyclictest0-21swapper/218:55:402
2545099913,53cyclictest0-21swapper/218:55:402
25449999121,31cyclictest25701-21df_abs20:35:201
2544999906,48cyclictest0-21swapper/118:55:031
2544799904,10cyclictest2788-21awk20:50:040
2544799903,80cyclictest0-21swapper/021:50:370
2544799903,11cyclictest18194-21kworker/0:219:21:000
25447999021,52cyclictest0-21swapper/017:35:270
25447999018,9cyclictest20495-21df_abs21:15:210
25447999017,8cyclictest9711-21open_files20:10:350
2545099892,55cyclictest0-21swapper/219:43:592
2545099892,55cyclictest0-21swapper/219:43:592
2544799895,77cyclictest0-21swapper/021:30:260
2544799893,26cyclictest0-21swapper/020:55:180
2545099883,48cyclictest1419-21runrttasks19:53:202
25447998822,10cyclictest26577-21munin-run18:00:100
25447998817,12cyclictest0-21swapper/017:10:430
2545099873,51cyclictest0-21swapper/217:10:492
2544799874,24cyclictest0-21swapper/020:50:190
25447998724,43cyclictest148161ssh19:30:330
25447998715,11cyclictest0-21swapper/017:45:270
2545099863,51cyclictest0-21swapper/220:34:122
2544799865,64cyclictest0-21swapper/021:20:370
2544799864,75cyclictest0-21swapper/022:12:360
2544799864,75cyclictest0-21swapper/020:25:410
25447998622,7cyclictest15364-21rm21:06:490
25447998616,13cyclictest0-21swapper/017:20:290
25447998615,10cyclictest121850irq/46-eth019:11:490
25447998611,14cyclictest0-21swapper/021:40:380
25447998611,14cyclictest0-21swapper/021:40:380
2544799853,76cyclictest10391-21ssh19:25:200
2544799853,12cyclictest0-21swapper/019:02:120
25447998525,53cyclictest17908-21gltestperf19:35:280
25447998521,10cyclictest0-21swapper/022:00:300
25447998516,11cyclictest0-21swapper/020:40:350
2545099843,50cyclictest0-21swapper/221:56:012
2544799844,71cyclictest0-21swapper/019:15:350
2544799843,74cyclictest0-21swapper/020:35:320
2544799843,72cyclictest0-21swapper/020:19:370
2544799843,22cyclictest0-21swapper/021:48:060
25447998421,7cyclictest30206-21latency_hist17:00:140
2545099833,49cyclictest0-21swapper/220:00:252
2545099833,49cyclictest0-21swapper/219:10:072
2544799834,72cyclictest0-21swapper/021:10:280
2544799834,72cyclictest0-21swapper/020:20:320
2544799834,72cyclictest0-21swapper/020:20:320
2544799833,73cyclictest0-21swapper/020:00:210
25447998325,42cyclictest27821-21ssh21:25:290
25447998321,8cyclictest1287-21snmpd16:54:390
25447998319,9cyclictest22787-21grep20:30:260
25447998314,12cyclictest0-21swapper/020:05:300
2545099823,50cyclictest0-21swapper/221:33:292
2544799826,70cyclictest0-21swapper/017:30:270
2544799826,70cyclictest0-21swapper/017:30:270
2544799824,71cyclictest0-21swapper/021:35:140
25447998215,9cyclictest27314-21aten_r1power_vo19:50:190
2544799814,71cyclictest0-21swapper/022:18:360
2544799814,70cyclictest0-21swapper/018:52:170
2544799813,71cyclictest0-21swapper/018:35:210
25447998126,49cyclictest0-21swapper/022:05:130
25447998111,65cyclictest22670-21ssh19:42:000
25447998111,65cyclictest22670-21ssh19:42:000
2545099803,51cyclictest0-21swapper/220:14:472
2545099802,49cyclictest0-21swapper/221:28:382
2544799804,70cyclictest0-21swapper/021:57:370
25447998015,11cyclictest0-21swapper/017:15:250
2544799798,15cyclictest0-21swapper/018:05:450
2544799795,65cyclictest0-21swapper/019:08:180
2544799794,12cyclictest0-21swapper/019:46:180
2544799793,69cyclictest0-21swapper/017:25:240
2544799793,23cyclictest0-21swapper/017:40:240
2544799783,68cyclictest10385-21ssh21:00:220
2544799783,68cyclictest10385-21ssh21:00:220
25447997812,13cyclictest0-21swapper/018:20:290
2545099772,48cyclictest0-21swapper/222:08:472
25447997723,10cyclictest1550-21munin-node18:15:270
25447997723,10cyclictest1550-21munin-node18:15:270
2544799769,16cyclictest0-21swapper/017:00:260
25447997619,10cyclictest0-21swapper/018:30:100
25447997612,9cyclictest121850irq/46-eth018:45:440
25447997612,8cyclictest354-21munin-node17:05:420
2544799754,8cyclictest1243-21lldpd18:30:220
25447997515,9cyclictest14453-21tr18:40:290
25447997511,12cyclictest0-21swapper/017:50:250
2544799734,22cyclictest0-21swapper/018:10:220
25447997311,10cyclictest1676-21nscd16:50:140
25447997311,10cyclictest1676-21nscd16:50:140
25450997032,22cyclictest0-21swapper/220:20:362
25450997032,22cyclictest0-21swapper/220:20:362
156332660,4sleep118-21rcuc/121:07:471
2545199656,51cyclictest0-21swapper/320:40:233
2545099654,52cyclictest0-21swapper/221:50:362
2544999654,54cyclictest0-21swapper/121:35:151
2544999654,54cyclictest0-21swapper/119:41:301
2544999654,54cyclictest0-21swapper/119:41:301
2545199645,51cyclictest0-21swapper/321:50:223
2545199644,53cyclictest0-21swapper/319:30:423
25449996435,11cyclictest0-21swapper/121:20:191
2545199639,47cyclictest30023-21aten_r1power_cu21:30:153
2545199634,51cyclictest0-21swapper/321:55:163
2545199634,51cyclictest0-21swapper/321:40:303
2545199634,51cyclictest0-21swapper/321:40:303
2545199633,52cyclictest0-21swapper/319:40:373
2545199633,52cyclictest0-21swapper/319:40:373
2545199632,55cyclictest0-21swapper/317:10:243
2544999633,46cyclictest20889-21kworker/u8:019:00:091
2544999633,46cyclictest20889-21kworker/u8:019:00:091
141692639,8sleep114237-21diskstats19:30:251
2545199624,51cyclictest0-21swapper/320:30:233
2544999625,15cyclictest0-21swapper/122:05:201
2545199614,50cyclictest0-21swapper/322:05:003
2545199614,50cyclictest0-21swapper/321:05:263
2545199613,52cyclictest30158-21head19:05:333
2545199613,52cyclictest0-21swapper/321:21:553
2545199613,51cyclictest19330-21gltestperf20:25:253
2545199613,50cyclictest0-21swapper/318:55:413
2545199613,50cyclictest0-21swapper/318:55:413
25450996133,13cyclictest0-21swapper/220:25:372
2544999615,51cyclictest0-21swapper/120:47:241
2544999613,52cyclictest0-21swapper/120:41:211
2544999613,51cyclictest0-21swapper/119:18:291
25449996122,13cyclictest0-21swapper/119:36:041
25449996121,13cyclictest26918-21ssh19:00:381
2545199604,49cyclictest0-21swapper/320:50:163
2545199604,49cyclictest0-21swapper/320:15:403
2545199603,50cyclictest0-21swapper/319:38:053
25450996033,13cyclictest0-21swapper/221:10:352
25450996031,12cyclictest0-21swapper/220:40:312
2544999605,28cyclictest0-21swapper/119:20:441
2544999604,50cyclictest0-21swapper/122:18:041
2544999604,50cyclictest0-21swapper/120:08:411
2545199595,47cyclictest19875-21sendmail_mailqu18:50:373
2545199594,49cyclictest0-21swapper/321:00:233
2545199594,49cyclictest0-21swapper/321:00:233
2545199594,49cyclictest0-21swapper/319:45:253
2545199594,48cyclictest0-21swapper/321:15:183
2545199594,48cyclictest0-21swapper/321:15:043
2545199594,48cyclictest0-21swapper/319:20:253
2545199593,49cyclictest0-21swapper/322:15:133
25450995933,10cyclictest19193-21uniq18:50:262
25450995932,12cyclictest0-21swapper/221:00:282
25450995932,12cyclictest0-21swapper/221:00:282
2544999596,14cyclictest0-21swapper/121:43:211
2544999596,14cyclictest0-21swapper/121:43:211
2544999594,49cyclictest0-21swapper/121:30:151
2544999594,49cyclictest0-21swapper/119:05:371
2544999594,48cyclictest0-21swapper/122:10:251
2544999594,48cyclictest0-21swapper/120:17:351
2544999594,37cyclictest0-21swapper/121:28:561
25449995920,13cyclictest0-21swapper/120:50:331
25449995918,13cyclictest0-21swapper/120:55:381
2545199586,45cyclictest0-21swapper/322:05:303
2545199584,47cyclictest26927-21fgrep19:00:383
2545199584,47cyclictest0-21swapper/320:35:273
2545199584,47cyclictest0-21swapper/317:50:133
2545199584,46cyclictest0-21swapper/320:10:203
2545199584,46cyclictest0-21swapper/317:05:273
2545199583,48cyclictest9765-21yum21:45:393
2545199583,48cyclictest6746-21cpuspeed_turbos20:55:193
25451995822,12cyclictest0-21swapper/322:11:063
2545099584,49cyclictest0-21swapper/222:17:162
25450995831,12cyclictest0-21swapper/218:25:332
25450995830,13cyclictest0-21swapper/217:00:152
2545099583,50cyclictest0-21swapper/219:56:342
2545099582,51cyclictest0-21swapper/221:46:532
2545099582,51cyclictest0-21swapper/221:07:032
2545099582,51cyclictest0-21swapper/219:22:132
2545099582,49cyclictest0-21swapper/222:02:452
2544999584,49cyclictest0-21swapper/119:46:441
2544999584,47cyclictest0-21swapper/121:58:001
2544999584,47cyclictest0-21swapper/121:01:361
2544999584,47cyclictest0-21swapper/121:01:361
25449995827,9cyclictest121850irq/46-eth018:25:101
25449995824,15cyclictest0-21swapper/118:45:401
2545199575,45cyclictest0-21swapper/319:15:283
2545199575,43cyclictest0-21swapper/320:00:233
2545199574,47cyclictest1843-21runrttasks20:47:063
2545199574,46cyclictest1486-21ssh19:10:433
2545199573,47cyclictest0-21swapper/318:20:443
2545099573,49cyclictest0-21swapper/219:25:432
2545099573,47cyclictest0-21swapper/218:32:072
2545099572,50cyclictest0-21swapper/220:35:492
2545099572,50cyclictest0-21swapper/220:05:252
2544999575,47cyclictest0-21swapper/120:11:071
2544999574,49cyclictest0-21swapper/119:13:271
2544999574,48cyclictest0-21swapper/120:21:491
2544999574,48cyclictest0-21swapper/120:21:491
2544999574,47cyclictest0-21swapper/121:50:461
25449995727,11cyclictest22610-21fschecks_time20:30:241
25449995722,16cyclictest0-21swapper/118:15:411
25449995722,16cyclictest0-21swapper/118:15:411
25449995722,16cyclictest0-21swapper/117:50:261
25449995717,13cyclictest0-21swapper/121:10:401
25449995712,25cyclictest0-21swapper/120:25:251
25782563,45sleep10-21swapper/117:08:521
2545199565,44cyclictest29251-21aten2.4-expect18:05:233
2545199564,45cyclictest31123-21df_inode19:55:233
2545199564,44cyclictest31735-21aten2.4-expect18:10:233
2545099563,48cyclictest0-21swapper/221:15:322
2545099562,50cyclictest0-21swapper/220:47:582
2545099562,49cyclictest0-21swapper/217:35:362
2544999567,29cyclictest0-21swapper/118:05:341
2544999566,30cyclictest0-21swapper/118:00:221
2544999564,46cyclictest0-21swapper/117:55:241
2544999564,31cyclictest0-21swapper/118:15:111
25449995636,13cyclictest31381-21gltestperf19:55:261
25449995622,15cyclictest0-21swapper/116:55:331
25449995622,14cyclictest0-21swapper/118:40:391
25449995619,12cyclictest0-21swapper/117:45:381
25449995618,32cyclictest11292-21if_eth019:25:281
2545199556,42cyclictest0-21swapper/319:50:223
2545199555,43cyclictest11784-21python19:25:383
2545199554,45cyclictest0-21swapper/320:05:233
2545199554,45cyclictest0-21swapper/317:50:263
2545199554,44cyclictest18173-21ls18:50:093
2545199554,27cyclictest0-21swapper/317:01:533
2545199553,45cyclictest0-21swapper/318:25:363
2545099553,47cyclictest0-21swapper/219:30:412
2545099553,45cyclictest0-21swapper/219:46:212
2544999555,31cyclictest0-21swapper/122:01:241
2544999555,30cyclictest0-21swapper/117:30:261
2544999555,30cyclictest0-21swapper/117:30:261
2544999554,31cyclictest0-21swapper/121:45:341
2544999554,29cyclictest0-21swapper/117:40:131
2544999554,26cyclictest0-21swapper/121:15:311
25449995522,14cyclictest0-21swapper/118:35:251
25449995521,16cyclictest0-21swapper/119:50:441
248599550,5rtkit-daemon2484-21rtkit-daemon21:35:552
190752553,45sleep10-21swapper/117:41:091
2545199544,45cyclictest0-21swapper/316:55:463
2545199543,45cyclictest9747-21munin-node18:30:293
2545199543,45cyclictest13959-21cpuspeed_turbos18:40:233
2545199543,43cyclictest13048-21cat17:30:283
2545199543,43cyclictest13048-21cat17:30:283
2544999544,31cyclictest0-21swapper/116:50:321
2544999543,45cyclictest0-21swapper/117:10:421
248599540,5rtkit-daemon2484-21rtkit-daemon17:50:412
248599540,5rtkit-daemon2484-21rtkit-daemon17:15:272
2545199534,43cyclictest0-21swapper/317:35:383
2545199534,42cyclictest0-21swapper/316:50:253
2545199533,43cyclictest28191-21cat21:25:373
2545199533,43cyclictest10073-21munin-node17:25:233
2545099534,14cyclictest0-21swapper/222:10:132
2545099533,45cyclictest0-21swapper/217:30:232
2545099533,45cyclictest0-21swapper/217:30:232
2545099533,41cyclictest0-21swapper/217:25:242
2544999534,30cyclictest0-21swapper/118:30:331
2544999534,27cyclictest0-21swapper/117:00:331
2544999533,44cyclictest0-21swapper/118:25:321
25449995320,15cyclictest0-21swapper/117:15:291
248599530,5rtkit-daemon2484-21rtkit-daemon18:45:242
248599530,5rtkit-daemon2484-21rtkit-daemon18:10:402
248599530,5rtkit-daemon2484-21rtkit-daemon18:05:402
248599530,5rtkit-daemon2484-21rtkit-daemon17:10:132
2545199522,44cyclictest0-21swapper/317:40:303
2545099524,42cyclictest0-21swapper/218:15:322
2545099524,42cyclictest0-21swapper/218:15:322
25450995218,27cyclictest30592-21tail17:00:252
248599520,5rtkit-daemon2484-21rtkit-daemon18:40:322
248599520,5rtkit-daemon2484-21rtkit-daemon18:35:242
2544999514,28cyclictest0-21swapper/117:25:131
248599510,5rtkit-daemon2484-21rtkit-daemon17:25:122
2470325132,10sleep10-21swapper/116:45:401
2470325132,10sleep10-21swapper/116:45:401
2545099503,41cyclictest0-21swapper/217:55:272
286872492,10sleep30-21swapper/318:01:433
2545199495,29cyclictest0-21swapper/317:16:403
25451994918,12cyclictest0-21swapper/318:35:403
248599490,5rtkit-daemon2484-21rtkit-daemon16:54:512
248599490,4rtkit-daemon2484-21rtkit-daemon18:05:102
2545199484,14cyclictest0-21swapper/317:55:413
2545099484,38cyclictest0-21swapper/218:20:232
2545099483,39cyclictest0-21swapper/217:40:292
2545099483,39cyclictest0-21swapper/216:50:152
2545099483,39cyclictest0-21swapper/216:50:152
2545199474,27cyclictest0-21swapper/318:20:113
2545199474,27cyclictest0-21swapper/318:20:113
251982454,35sleep30-21swapper/316:47:273
251982454,35sleep30-21swapper/316:47:273
2545199443,10cyclictest8745-21munin-node17:20:363
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional