You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-16 - 22:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Sat May 16, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
294842730,4sleep029482-21tr08:10:160
56332644,12sleep20-21swapper/206:48:242
996299634,51cyclictest0-21swapper/308:31:103
9960996321,25cyclictest4284-21open_inodes06:45:271
248599630,3rtkit-daemon9502-21ssh06:54:353
207882633,22sleep20-21swapper/207:56:522
128472634,50sleep30-21swapper/307:45:203
9960996242,14cyclictest0-21swapper/108:10:281
180042623,11sleep00-21swapper/007:05:230
996199619,25cyclictest0-21swapper/207:35:302
996199619,25cyclictest0-21swapper/207:35:302
161352614,48sleep00-21swapper/006:05:130
996199605,14cyclictest0-21swapper/209:21:582
996099603,35cyclictest0-21swapper/108:41:171
9960996013,25cyclictest10549-21sed05:50:351
150962603,11sleep30-21swapper/310:11:373
996299593,48cyclictest0-21swapper/307:19:353
996199594,12cyclictest0-21swapper/209:05:052
996199593,42cyclictest0-21swapper/209:53:572
9961995923,13cyclictest9498-21munin-node10:05:032
9955995930,10cyclictest30673-21telnet07:25:110
275202593,49sleep00-21swapper/007:20:140
235962593,48sleep10-21swapper/109:36:041
9962995841,11cyclictest25800-21gltestperf09:40:123
996299583,36cyclictest22205-21aten2.4-expect05:10:163
996199585,13cyclictest1419-21runrttasks09:56:342
996199583,24cyclictest0-21swapper/208:50:102
9961995824,14cyclictest15733-21diskstats07:50:132
9961995813,27cyclictest0-21swapper/208:00:232
9960995838,13cyclictest0-21swapper/108:20:141
9962995740,10cyclictest15159-21chrt07:50:073
996299574,10cyclictest8801-21df07:40:143
996299573,12cyclictest0-21swapper/309:00:123
996299573,12cyclictest0-21swapper/309:00:123
9962995719,19cyclictest0-21swapper/308:29:253
9962995716,24cyclictest360-21ssh07:27:073
996199575,30cyclictest0-21swapper/207:25:272
996199574,35cyclictest0-21swapper/208:22:132
996199574,27cyclictest0-21swapper/209:10:192
996199573,49cyclictest0-21swapper/208:31:452
9961995714,24cyclictest17928-21forks05:00:202
996099574,37cyclictest0-21swapper/109:42:421
995599573,47cyclictest0-21swapper/008:55:170
995599573,25cyclictest0-21swapper/009:32:440
996299565,30cyclictest0-21swapper/307:37:053
996299565,30cyclictest0-21swapper/307:37:053
9962995621,12cyclictest0-21swapper/307:20:353
996199566,44cyclictest0-21swapper/209:59:562
996199566,21cyclictest2378-21ssh07:30:152
996199566,13cyclictest0-21swapper/208:41:442
996199564,36cyclictest0-21swapper/209:48:272
9961995624,12cyclictest0-21swapper/207:20:182
9961995618,23cyclictest0-21swapper/209:39:522
9961995611,25cyclictest0-21swapper/209:25:242
9960995639,10cyclictest2056-21expr05:35:171
9955995633,7cyclictest19632-21ssh07:55:200
9955995633,10cyclictest29333-21telnet05:25:140
254602564,45sleep00-21swapper/008:51:040
996299558,25cyclictest0-21swapper/308:18:093
9962995520,13cyclictest0-21swapper/306:15:013
9962995520,12cyclictest0-21swapper/307:12:413
9962995510,37cyclictest0-21swapper/308:50:203
996199553,37cyclictest0-21swapper/207:06:302
9961995528,9cyclictest7250irq/45-ahci07:03:092
9961995522,13cyclictest0-21swapper/208:35:182
9960995540,9cyclictest9498-21munin-node10:05:151
9960995539,11cyclictest0-21swapper/109:09:341
9960995536,13cyclictest0-21swapper/108:50:411
9960995522,11cyclictest0-21swapper/107:01:041
995599553,45cyclictest0-21swapper/009:40:070
248599550,6rtkit-daemon2484-21rtkit-daemon08:25:092
248599550,5rtkit-daemon2484-21rtkit-daemon08:12:322
248599550,5rtkit-daemon2484-21rtkit-daemon06:15:292
248599550,5rtkit-daemon2484-21rtkit-daemon06:15:292
248599550,5rtkit-daemon2484-21rtkit-daemon05:55:222
996299544,44cyclictest2691-21diskmemload09:05:043
996299544,44cyclictest0-21swapper/307:30:273
996299543,45cyclictest6139-21ssh10:00:033
996299543,11cyclictest0-21swapper/306:55:273
996299543,11cyclictest0-21swapper/306:55:273
996199546,29cyclictest10659-21perl06:55:172
996199546,29cyclictest10659-21perl06:55:172
996199543,36cyclictest0-21swapper/208:58:022
996199543,35cyclictest11743-21munin-node07:45:162
996199543,23cyclictest0-21swapper/208:48:192
9961995422,14cyclictest0-21swapper/208:15:182
9961995422,14cyclictest0-21swapper/207:10:172
9961995422,12cyclictest0-21swapper/208:09:552
9961995420,9cyclictest8941-21aten_r1power_cu05:50:142
9961995417,30cyclictest0-21swapper/207:15:172
996099545,29cyclictest0-21swapper/106:20:011
996099545,29cyclictest0-21swapper/106:20:011
996099544,28cyclictest0-21swapper/108:05:311
996099544,25cyclictest0-21swapper/106:50:101
9960995436,13cyclictest0-21swapper/110:10:031
9960995435,13cyclictest0-21swapper/105:15:281
9960995430,10cyclictest0-21swapper/108:25:271
9960995426,12cyclictest17407-21runrttasks07:51:551
9960995425,12cyclictest0-21swapper/107:55:241
304052542,9sleep00-21swapper/009:46:230
248599540,5rtkit-daemon2484-21rtkit-daemon06:35:363
248599540,5rtkit-daemon2484-21rtkit-daemon06:31:063
132202543,43sleep10-21swapper/105:56:431
996299534,43cyclictest0-21swapper/309:56:363
996299533,12cyclictest0-21swapper/308:20:143
9962995328,9cyclictest21363-21ssh08:45:193
996299532,44cyclictest0-21swapper/305:07:003
996199534,33cyclictest0-21swapper/209:42:142
996199534,30cyclictest0-21swapper/209:15:232
996199534,29cyclictest0-21swapper/209:00:272
996199534,29cyclictest0-21swapper/209:00:272
9961995326,8cyclictest15997-21latency_hist10:14:502
9961995321,14cyclictest0-21swapper/206:25:182
996099535,28cyclictest0-21swapper/109:50:051
996099535,28cyclictest0-21swapper/107:45:071
9960995337,11cyclictest0-21swapper/107:29:271
9960995336,12cyclictest0-21swapper/107:14:401
9960995316,32cyclictest0-21swapper/107:07:111
9960995315,21cyclictest0-21swapper/108:45:271
995599536,39cyclictest0-21swapper/008:45:170
9955995333,8cyclictest13713-21munin-node06:00:180
9955995333,14cyclictest0-21swapper/006:25:350
995599533,12cyclictest0-21swapper/008:40:140
248599530,5rtkit-daemon2484-21rtkit-daemon09:31:142
248599530,5rtkit-daemon2484-21rtkit-daemon06:20:212
248599530,5rtkit-daemon2484-21rtkit-daemon05:25:312
248599530,5rtkit-daemon2484-21rtkit-daemon04:46:032
248599530,5rtkit-daemon2484-21rtkit-daemon04:46:032
160232533,11sleep00-21swapper/007:02:570
158712532,9sleep00-21swapper/008:38:020
147152533,43sleep114859-21latency_hist04:55:041
996299524,10cyclictest26626-21ntp_states08:05:253
996299523,12cyclictest0-21swapper/308:01:143
996299523,12cyclictest0-21swapper/307:05:273
9962995223,13cyclictest0-21swapper/309:54:033
9962995223,12cyclictest0-21swapper/307:55:173
996299522,46cyclictest0-21swapper/309:39:173
996199526,30cyclictest0-21swapper/207:40:022
996199526,28cyclictest0-21swapper/206:05:142
996199525,28cyclictest0-21swapper/206:40:332
996199525,28cyclictest0-21swapper/205:05:392
996199524,29cyclictest0-21swapper/205:20:252
996199524,28cyclictest0-21swapper/206:50:212
996199524,27cyclictest0-21swapper/204:45:052
996199524,27cyclictest0-21swapper/204:45:052
9961995221,13cyclictest0-21swapper/206:35:232
9961995221,13cyclictest0-21swapper/205:40:352
9961995219,13cyclictest0-21swapper/205:30:392
9961995219,13cyclictest0-21swapper/205:30:392
996099526,28cyclictest0-21swapper/108:30:491
996099525,25cyclictest3634-21taskset07:31:041
996099524,28cyclictest0-21swapper/109:55:041
996099524,27cyclictest0-21swapper/108:55:061
9960995237,9cyclictest22855-21grep08:00:161
9960995236,10cyclictest19920-21munin-node06:10:321
9960995225,12cyclictest0-21swapper/110:00:401
9960995217,13cyclictest25426-21wc07:15:311
995599525,41cyclictest0-21swapper/008:20:110
995599524,42cyclictest0-21swapper/007:45:140
9955995232,8cyclictest21518-21munin-node09:35:250
9955995230,8cyclictest32275-21ssh09:50:090
142742523,43sleep10-21swapper/109:24:071
996299515,27cyclictest0-21swapper/310:09:513
996299514,41cyclictest0-21swapper/309:30:573
9962995136,9cyclictest17705-21cut05:00:173
996299513,11cyclictest0-21swapper/309:20:243
9962995118,13cyclictest0-21swapper/306:49:593
996199515,28cyclictest0-21swapper/204:55:222
996199514,27cyclictest0-21swapper/206:30:232
9961995120,13cyclictest0-21swapper/206:00:322
9961995120,12cyclictest0-21swapper/205:10:192
996099516,27cyclictest0-21swapper/109:09:561
996099515,26cyclictest0-21swapper/107:39:551
996099515,26cyclictest0-21swapper/107:39:551
996099514,40cyclictest0-21swapper/106:35:111
996099514,28cyclictest0-21swapper/109:25:111
996099514,27cyclictest0-21swapper/108:15:141
9960995133,13cyclictest0-21swapper/109:31:461
9960995122,12cyclictest0-21swapper/105:20:281
9960995121,13cyclictest0-21swapper/109:45:181
995599516,39cyclictest0-21swapper/005:31:060
995599516,39cyclictest0-21swapper/005:31:060
995599514,40cyclictest0-21swapper/009:00:080
995599514,40cyclictest0-21swapper/009:00:080
995599514,24cyclictest0-21swapper/006:55:220
995599514,24cyclictest0-21swapper/006:55:220
9955995133,7cyclictest2691-21diskmemload09:59:010
9955995131,8cyclictest4160-21munin-node05:40:350
9955995130,7cyclictest5055-21ssh06:46:280
995599513,44cyclictest0-21swapper/009:29:010
9955995126,11cyclictest0-21swapper/004:49:020
9955995126,11cyclictest0-21swapper/004:49:020
9955995124,12cyclictest0-21swapper/007:35:120
9955995124,12cyclictest0-21swapper/007:35:120
46982513,41sleep04757-21aten_r1power_po09:10:070
248599510,5rtkit-daemon2484-21rtkit-daemon05:35:312
217052513,42sleep10-21swapper/105:07:541
996299503,11cyclictest0-21swapper/308:40:143
9962995021,13cyclictest0-21swapper/306:05:223
9962995018,13cyclictest0-21swapper/307:00:313
996199505,26cyclictest0-21swapper/206:10:252
996199504,29cyclictest0-21swapper/205:20:022
996199504,28cyclictest0-21swapper/205:45:282
996099505,27cyclictest0-21swapper/109:17:291
9960995036,9cyclictest10810-21rm07:42:341
9960995021,10cyclictest10029-21ssh06:55:111
9960995021,10cyclictest10029-21ssh06:55:111
9960995020,13cyclictest0-21swapper/109:04:461
9960995020,13cyclictest0-21swapper/109:04:461
9960995020,13cyclictest0-21swapper/106:24:201
9955995032,7cyclictest8868-21ssh08:27:130
9955995031,12cyclictest0-21swapper/007:30:310
995599503,40cyclictest0-21swapper/010:05:170
995599503,21cyclictest0-21swapper/008:33:470
9955995024,12cyclictest0-21swapper/007:19:310
9955995023,12cyclictest0-21swapper/008:15:300
42522502,42sleep00-21swapper/009:09:300
277362503,41sleep10-21swapper/106:29:161
229102502,42sleep00-21swapper/006:18:350
229102502,42sleep00-21swapper/006:18:350
996299493,27cyclictest0-21swapper/306:15:173
996299493,27cyclictest0-21swapper/306:15:173
9962994922,9cyclictest25646-21munin-node06:25:133
9962994921,12cyclictest0-21swapper/308:39:553
9962994919,12cyclictest0-21swapper/308:55:233
9962994914,20cyclictest1695-21telnet05:35:143
996199494,27cyclictest0-21swapper/204:50:172
996099496,12cyclictest0-21swapper/107:20:041
996099493,27cyclictest0-21swapper/108:35:101
995599493,40cyclictest0-21swapper/007:44:040
9955994923,12cyclictest0-21swapper/005:50:210
9955994923,12cyclictest0-21swapper/005:00:030
25472492,40sleep00-21swapper/006:43:180
248599490,4rtkit-daemon2484-21rtkit-daemon08:10:543
113202492,40sleep00-21swapper/005:55:090
996299488,22cyclictest0-21swapper/309:15:203
996299484,10cyclictest0-21swapper/309:45:303
996299483,28cyclictest0-21swapper/309:14:533
9962994817,14cyclictest0-21swapper/309:25:033
996099485,26cyclictest0-21swapper/106:40:121
9960994816,12cyclictest1419-21runrttasks06:30:241
995599484,8cyclictest9235-21munin-run10:04:510
9955994831,6cyclictest9222-21ssh06:53:370
9955994830,6cyclictest24193-21ssh08:01:590
995599483,40cyclictest0-21swapper/009:20:120
995599483,39cyclictest0-21swapper/005:35:150
995599483,38cyclictest0-21swapper/009:15:120
9955994821,12cyclictest0-21swapper/006:35:000
192042482,39sleep00-21swapper/005:01:240
167792483,39sleep00-21swapper/007:50:290
996299473,37cyclictest15840-21gltestperf04:55:233
9962994726,6cyclictest8700-21munin-run05:50:003
9962994724,9cyclictest24495-21munin-node05:15:283
996099473,26cyclictest0-21swapper/105:45:161
996099473,26cyclictest0-21swapper/104:45:051
996099473,26cyclictest0-21swapper/104:45:051
9960994729,12cyclictest0-21swapper/105:10:361
9960994720,11cyclictest0-21swapper/105:35:021
9960994720,11cyclictest0-21swapper/105:35:021
9960994712,9cyclictest15789-21gltestperf04:55:221
995599473,37cyclictest0-21swapper/005:15:070
9955994728,8cyclictest27812-21ssh08:07:510
9955994728,7cyclictest9594-21kworker/0:110:10:020
84292472,9sleep00-21swapper/005:46:390
228122472,39sleep00-21swapper/007:12:360
191902473,38sleep10-21swapper/105:01:131
996299463,11cyclictest0-21swapper/306:20:243
996299463,10cyclictest0-21swapper/305:20:363
9962994622,9cyclictest10179-21munin-node04:45:163
9962994622,9cyclictest10179-21munin-node04:45:163
9962994618,12cyclictest0-21swapper/305:40:343
9962994616,12cyclictest0-21swapper/305:30:373
9962994616,12cyclictest0-21swapper/305:30:373
996099464,26cyclictest0-21swapper/106:05:321
996099464,23cyclictest14838-21memory06:00:251
9955994630,12cyclictest0-21swapper/006:10:340
995599463,38cyclictest0-21swapper/005:22:550
9955994618,12cyclictest0-21swapper/005:10:030
9955994613,9cyclictest32587-21crond06:39:590
240412462,9sleep00-21swapper/005:12:160
140292462,37sleep00-21swapper/004:50:360
996299453,36cyclictest0-21swapper/306:44:593
9962994528,10cyclictest12932-21cpuspeed_turbos04:50:183
9962994520,11cyclictest0-21swapper/305:55:143
996099455,34cyclictest0-21swapper/105:40:331
996099453,37cyclictest0-21swapper/105:25:141
9960994515,10cyclictest11984-21munin-node04:45:391
9960994515,10cyclictest11984-21munin-node04:45:391
995599454,33cyclictest0-21swapper/006:20:110
9962994428,9cyclictest14058-21cut06:00:153
996299434,11cyclictest0-21swapper/305:50:143
996299433,34cyclictest0-21swapper/305:25:193
96862424,32sleep00-21swapper/004:41:580
96862424,32sleep00-21swapper/004:41:580
97662404,29sleep30-21swapper/304:43:023
97662404,29sleep30-21swapper/304:43:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional