You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-16 - 12:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Sat May 16, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
15402920,4sleep337-21ksoftirqd/320:58:533
14703996826,35cyclictest7774-21df_abs21:55:352
182632670,3sleep118267-21rm19:46:031
1469999675,48cyclictest0-21swapper/021:14:060
1470399663,55cyclictest0-21swapper/220:55:442
1470399653,54cyclictest0-21swapper/220:41:492
1470399653,54cyclictest0-21swapper/217:40:482
1470399653,54cyclictest0-21swapper/217:40:482
1470399644,52cyclictest17394-21aten_r1power_fr22:10:322
1470399643,11cyclictest0-21swapper/219:00:452
1470399643,11cyclictest0-21swapper/219:00:452
248599630,4rtkit-daemon2484-21rtkit-daemon20:13:583
1470499634,38cyclictest18504-21cut20:35:403
268642627,12sleep10-21swapper/120:47:351
1470399624,12cyclictest0-21swapper/222:00:432
1470399623,51cyclictest7670-21munin-node20:20:582
1470399623,51cyclictest0-21swapper/218:50:482
1470399623,50cyclictest17633-21needreboot19:45:512
14702996228,13cyclictest0-21swapper/122:01:451
124832624,12sleep00-21swapper/021:15:320
1470499614,39cyclictest0-21swapper/322:06:383
1470499614,38cyclictest0-21swapper/320:54:233
1470399614,49cyclictest27199-21fschecks_time20:00:422
1469999614,39cyclictest0-21swapper/016:51:030
14699996116,27cyclictest8910-21needreboot20:20:500
191672603,50sleep30-21swapper/316:51:463
1470499605,37cyclictest0-21swapper/321:24:183
14704996016,22cyclictest7437-21diskmemload20:48:203
1470399604,49cyclictest0-21swapper/221:05:352
1470399604,49cyclictest0-21swapper/221:05:352
1470399604,48cyclictest0-21swapper/218:58:142
1470399603,50cyclictest0-21swapper/221:04:262
274462593,12sleep20-21swapper/219:12:542
248599590,4rtkit-daemon2484-21rtkit-daemon21:09:043
248599590,4rtkit-daemon2484-21rtkit-daemon21:09:043
185382593,48sleep30-21swapper/319:00:423
185382593,48sleep30-21swapper/319:00:423
181192593,11sleep10-21swapper/121:22:141
1470499594,37cyclictest0-21swapper/320:00:593
14704995913,26cyclictest0-21swapper/320:08:053
14704995911,22cyclictest0-21swapper/319:45:563
1470399598,44cyclictest29984-21ssh21:40:372
1470399593,49cyclictest0-21swapper/220:30:352
14702995939,13cyclictest0-21swapper/121:50:271
14699995938,14cyclictest0-21swapper/019:01:000
14699995938,14cyclictest0-21swapper/019:01:000
248599580,6rtkit-daemon2484-21rtkit-daemon21:35:483
248599580,4rtkit-daemon2484-21rtkit-daemon17:58:043
248599580,4rtkit-daemon2484-21rtkit-daemon17:50:343
1470499587,28cyclictest0-21swapper/319:43:453
1470499587,28cyclictest0-21swapper/319:43:453
1470499583,38cyclictest7316-21iostat_ios19:30:483
1470399586,46cyclictest0-21swapper/219:35:532
1470399584,46cyclictest0-21swapper/221:15:222
1470399583,9cyclictest0-21swapper/219:55:512
1470399583,48cyclictest0-21swapper/221:31:342
1470399583,48cyclictest0-21swapper/220:06:592
1470399583,47cyclictest0-21swapper/219:40:362
1470399583,47cyclictest0-21swapper/219:40:362
1470399583,21cyclictest8362-21tune2fs18:45:452
1470399583,12cyclictest0-21swapper/219:31:382
1470299584,47cyclictest0-21swapper/119:34:441
14699995843,9cyclictest32670-21grep19:20:440
1469999584,29cyclictest0-21swapper/019:42:380
1469999584,29cyclictest0-21swapper/019:42:380
47352573,47sleep10-21swapper/121:02:431
164322573,8sleep116401-21yum-updatesd-he20:31:271
1470499575,36cyclictest0-21swapper/319:55:043
1470499574,36cyclictest0-21swapper/320:26:393
1470499574,36cyclictest0-21swapper/320:26:393
1470499574,36cyclictest0-21swapper/319:26:213
14704995718,23cyclictest0-21swapper/321:44:223
1470399574,46cyclictest3541-21fschecks_count19:25:432
1470399573,27cyclictest0-21swapper/218:40:512
14702995737,14cyclictest0-21swapper/122:13:271
1469999575,44cyclictest0-21swapper/020:55:380
54662563,45sleep15592-21tr18:40:401
325432563,45sleep20-21swapper/217:20:522
193832563,47sleep20-21swapper/220:35:552
1470499565,28cyclictest0-21swapper/317:11:503
1470499563,35cyclictest0-21swapper/320:31:593
14704995622,13cyclictest0-21swapper/322:10:313
14704995617,21cyclictest4312-21sed21:50:353
1470399563,46cyclictest0-21swapper/218:25:522
14702995633,7cyclictest20989-21cat20:40:241
1469999564,34cyclictest0-21swapper/020:45:370
14699995625,11cyclictest18836-21python22:10:520
184212554,45sleep20-21swapper/221:23:202
160302553,45sleep216108-21missed_timers16:45:572
1470499559,24cyclictest0-21swapper/322:02:563
1470499555,26cyclictest0-21swapper/319:07:353
1470499554,36cyclictest0-21swapper/319:14:093
14704995523,9cyclictest667-21ntp_states19:20:523
14704995521,12cyclictest1287-21snmpd18:55:593
14704995516,20cyclictest0-21swapper/321:26:093
14704995511,23cyclictest0-21swapper/321:45:303
14704995511,23cyclictest0-21swapper/321:45:303
1470399554,12cyclictest0-21swapper/221:50:362
14703995536,13cyclictest0-21swapper/220:26:162
14703995536,13cyclictest0-21swapper/220:26:162
14703995533,15cyclictest0-21swapper/221:35:402
1470299554,43cyclictest0-21swapper/119:00:371
1470299554,43cyclictest0-21swapper/119:00:371
14702995535,13cyclictest0-21swapper/121:18:561
14702995534,14cyclictest0-21swapper/120:53:231
1469999554,42cyclictest0-21swapper/022:00:510
14699995538,10cyclictest11650-21cpuspeed_turbos17:45:420
14982543,11sleep20-21swapper/219:21:532
1470499546,42cyclictest0-21swapper/320:40:543
1470499545,29cyclictest0-21swapper/320:20:593
1470499545,28cyclictest0-21swapper/317:26:053
1470499545,26cyclictest0-21swapper/318:17:003
1470499544,45cyclictest0-21swapper/319:16:153
1470499544,28cyclictest0-21swapper/321:00:503
1470499544,28cyclictest0-21swapper/317:10:323
14704995424,11cyclictest7437-21diskmemload21:31:183
14704995423,13cyclictest0-21swapper/319:35:403
1470399545,42cyclictest0-21swapper/222:06:102
1470399544,42cyclictest0-21swapper/220:16:082
1470399543,45cyclictest0-21swapper/220:47:002
1470399543,36cyclictest0-21swapper/219:54:572
14702995438,11cyclictest0-21swapper/119:56:571
14702995437,12cyclictest0-21swapper/119:23:031
14702995413,24cyclictest32754-21munin-node21:45:451
14702995413,24cyclictest32754-21munin-node21:45:451
1469999545,29cyclictest0-21swapper/018:45:580
1469999545,26cyclictest0-21swapper/020:15:420
1469999543,29cyclictest0-21swapper/016:45:430
14699995421,13cyclictest0-21swapper/022:09:490
14699995414,25cyclictest0-21swapper/018:55:030
300582533,43sleep00-21swapper/018:24:190
300582533,43sleep00-21swapper/018:24:190
264012533,9sleep00-21swapper/017:07:440
248599530,5rtkit-daemon2484-21rtkit-daemon16:40:442
248599530,4rtkit-daemon2484-21rtkit-daemon18:00:563
246542533,44sleep00-21swapper/019:10:060
208372533,9sleep00-21swapper/018:05:320
1470499535,28cyclictest0-21swapper/318:45:463
1470499535,26cyclictest1419-21runrttasks20:15:513
1470499535,25cyclictest0-21swapper/317:46:563
1470499534,28cyclictest0-21swapper/321:15:533
1470499533,44cyclictest0-21swapper/321:12:113
14704995320,10cyclictest8375-21ssh21:55:443
14703995338,9cyclictest13736-21strings21:15:462
1470399533,43cyclictest0-21swapper/219:17:312
1470299538,37cyclictest0-21swapper/119:10:441
1470299535,29cyclictest0-21swapper/117:25:301
1470299534,29cyclictest0-21swapper/120:45:241
1469999538,27cyclictest0-21swapper/018:55:500
1469999535,29cyclictest0-21swapper/019:37:220
1469999535,28cyclictest0-21swapper/017:35:510
1469999535,14cyclictest0-21swapper/021:04:590
1469999534,30cyclictest0-21swapper/019:30:450
1469999534,14cyclictest0-21swapper/019:53:020
14699995336,10cyclictest8974-21grep21:55:530
14699995320,13cyclictest0-21swapper/020:35:500
14699995320,13cyclictest0-21swapper/020:32:430
61572523,9sleep00-21swapper/021:52:330
301502522,44sleep10-21swapper/118:25:281
301502522,44sleep10-21swapper/118:25:281
285232523,9sleep00-21swapper/021:38:140
248599520,5rtkit-daemon2484-21rtkit-daemon19:55:593
248599520,5rtkit-daemon2484-21rtkit-daemon18:05:483
1470499525,27cyclictest11566-21df18:50:423
1470499525,27cyclictest0-21swapper/317:40:583
1470499525,27cyclictest0-21swapper/317:40:583
1470499525,27cyclictest0-21swapper/317:35:513
1470499525,26cyclictest0-21swapper/318:37:033
1470499524,28cyclictest0-21swapper/318:30:543
1470499524,28cyclictest0-21swapper/318:26:043
14704995221,13cyclictest0-21swapper/318:40:493
1470399523,43cyclictest0-21swapper/217:01:002
1470299525,14cyclictest0-21swapper/120:05:431
1470299524,30cyclictest0-21swapper/121:35:341
1470299524,30cyclictest0-21swapper/117:45:301
1470299524,30cyclictest0-21swapper/117:45:301
1470299524,29cyclictest0-21swapper/120:03:131
1470299524,29cyclictest0-21swapper/118:50:411
1470299524,24cyclictest0-21swapper/122:07:191
1470299523,30cyclictest0-21swapper/120:25:471
1470299523,30cyclictest0-21swapper/120:25:471
1470299523,24cyclictest0-21swapper/121:59:371
14702995223,13cyclictest0-21swapper/117:10:451
14702995222,12cyclictest0-21swapper/118:25:451
1469999525,28cyclictest0-21swapper/020:05:410
1469999525,27cyclictest0-21swapper/021:25:470
1469999525,27cyclictest0-21swapper/021:24:150
1469999525,14cyclictest0-21swapper/020:13:010
1469999524,28cyclictest0-21swapper/020:50:450
1469999524,28cyclictest0-21swapper/020:40:460
1469999524,27cyclictest17874-21ssh19:45:550
1469999524,27cyclictest0-21swapper/021:46:430
1469999524,27cyclictest0-21swapper/021:46:430
1469999524,27cyclictest0-21swapper/019:12:440
14699995233,12cyclictest23795-21grep19:55:420
14699995218,14cyclictest0-21swapper/020:30:070
14699995218,14cyclictest0-21swapper/020:30:070
14699995211,23cyclictest23232-21entropy21:30:390
66532513,40sleep20-21swapper/217:35:432
60552513,9sleep00-21swapper/017:32:510
1470499515,27cyclictest0-21swapper/318:20:573
1470499515,27cyclictest0-21swapper/318:20:573
1470499514,28cyclictest0-21swapper/317:35:303
1470499514,27cyclictest0-21swapper/318:10:533
1470499514,27cyclictest0-21swapper/317:15:533
14704995131,11cyclictest15851-21hwlatdetect16:45:533
14704995120,12cyclictest0-21swapper/317:20:563
14703995135,11cyclictest0-21swapper/217:55:442
1470399513,25cyclictest3299-21ssh21:49:232
1470399513,25cyclictest3299-21ssh21:49:232
1470399512,41cyclictest0-21swapper/217:50:512
1470299515,28cyclictest0-21swapper/119:17:111
1470299515,28cyclictest0-21swapper/119:07:241
1470299514,40cyclictest0-21swapper/121:10:411
1470299514,28cyclictest0-21swapper/121:30:551
1470299513,39cyclictest0-21swapper/119:35:571
14702995123,13cyclictest0-21swapper/121:41:391
14702995123,13cyclictest0-21swapper/118:55:401
1469999515,39cyclictest32496-21ls21:45:200
1469999515,27cyclictest0-21swapper/017:10:460
1469999514,40cyclictest0-21swapper/020:00:560
1469999514,28cyclictest0-21swapper/019:28:140
1469999514,28cyclictest0-21swapper/018:35:580
1469999514,28cyclictest0-21swapper/016:55:550
1469999514,28cyclictest0-21swapper/016:55:550
1469999514,27cyclictest0-21swapper/021:08:290
1469999514,27cyclictest0-21swapper/021:08:290
1469999514,27cyclictest0-21swapper/019:20:180
1469999514,27cyclictest0-21swapper/017:40:580
1469999514,27cyclictest0-21swapper/017:40:580
1469999514,27cyclictest0-21swapper/017:15:480
1469999514,26cyclictest0-21swapper/018:20:290
306082502,9sleep10-21swapper/117:15:591
1470499503,27cyclictest0-21swapper/316:56:013
1470499503,27cyclictest0-21swapper/316:56:013
1470399504,8cyclictest962-21cpu20:10:372
1470399504,27cyclictest0-21swapper/218:05:472
14703995019,13cyclictest0-21swapper/218:35:522
1470299505,28cyclictest0-21swapper/117:35:511
1470299505,27cyclictest0-21swapper/117:50:301
1470299504,40cyclictest0-21swapper/119:50:591
1470299504,28cyclictest0-21swapper/120:55:391
1470299504,28cyclictest0-21swapper/117:00:481
1470299504,28cyclictest0-21swapper/116:45:511
1470299504,27cyclictest0-21swapper/120:12:031
1469999504,27cyclictest0-21swapper/018:00:450
87802492,41sleep10-21swapper/121:10:091
87802492,41sleep10-21swapper/121:10:091
1470499494,27cyclictest0-21swapper/317:00:593
1470399494,27cyclictest0-21swapper/220:50:372
1470399494,27cyclictest0-21swapper/218:30:442
1470399493,28cyclictest0-21swapper/218:10:402
1470399493,23cyclictest0-21swapper/219:07:242
1470399492,42cyclictest0-21swapper/217:45:572
1470299495,27cyclictest0-21swapper/118:06:031
1470299495,27cyclictest0-21swapper/118:00:501
1470299494,29cyclictest0-21swapper/118:45:461
1470299494,28cyclictest0-21swapper/121:25:321
1470299494,28cyclictest0-21swapper/120:22:051
1470299494,28cyclictest0-21swapper/120:15:441
1470299494,28cyclictest0-21swapper/117:26:001
14702994924,11cyclictest0-21swapper/119:27:131
14702994920,12cyclictest0-21swapper/119:44:281
14702994920,12cyclictest0-21swapper/119:44:281
1469999495,26cyclictest0-21swapper/017:20:500
71542483,39sleep00-21swapper/018:41:560
60892482,9sleep20-21swapper/217:33:172
287502483,9sleep228862-21head18:20:462
287502483,9sleep228862-21head18:20:462
180892482,40sleep10-21swapper/117:58:481
1470499484,26cyclictest0-21swapper/316:45:323
1470399483,25cyclictest0-21swapper/221:25:342
1470299485,27cyclictest0-21swapper/118:35:591
1470299484,35cyclictest0-21swapper/117:30:411
1470299484,27cyclictest0-21swapper/118:10:551
1470299483,28cyclictest0-21swapper/118:31:011
1469999484,37cyclictest0-21swapper/018:30:580
241892473,38sleep00-21swapper/017:05:020
1470399473,26cyclictest0-21swapper/217:11:012
1470299474,36cyclictest0-21swapper/116:55:541
1470299474,36cyclictest0-21swapper/116:55:541
14702994726,15cyclictest0-21swapper/117:50:511
14702994718,12cyclictest0-21swapper/117:06:071
1469999475,34cyclictest0-21swapper/018:25:400
1469999474,26cyclictest0-21swapper/018:11:010
14699994719,12cyclictest0-21swapper/017:53:120
179192463,36sleep00-21swapper/017:56:330
1470399464,12cyclictest0-21swapper/217:15:562
1470299464,12cyclictest0-21swapper/118:15:561
14702994616,14cyclictest0-21swapper/116:50:441
1469999464,36cyclictest0-21swapper/017:25:540
14703994530,9cyclictest19876-21find18:00:582
1470399453,25cyclictest0-21swapper/217:05:472
144522454,34sleep00-21swapper/016:42:450
14703994430,9cyclictest20060-21cpuspeed_turbos16:55:462
14703994430,9cyclictest20060-21cpuspeed_turbos16:55:462
14052432,34sleep20-21swapper/217:25:312
14703994216,10cyclictest25930-21grep18:15:422
1470399403,29cyclictest0-21swapper/216:50:502
1470299404,13cyclictest0-21swapper/116:45:321
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional