You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-29 - 16:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Wed Apr 29, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3193021190,6sleep30-21swapper/307:46:323
529221080,5chrt5294-21fschecks_count07:56:141
6085999537,10cyclictest0-21swapper/008:06:200
6085999228,8cyclictest4493-21ssh07:55:560
6085999228,8cyclictest4493-21ssh07:55:560
122012890,12sleep2609299cyclictest08:55:052
6085998721,12cyclictest0-21swapper/007:10:340
608599854,14cyclictest0-21swapper/008:35:330
608599843,40cyclictest0-21swapper/008:37:480
6085997814,11cyclictest0-21swapper/010:15:490
6090997025,18cyclictest22567-21tail09:56:241
6090997025,18cyclictest22567-21tail09:56:241
609299685,54cyclictest0-21swapper/210:16:262
6090996836,9cyclictest9221-21df_abs10:26:041
6090996835,10cyclictest0-21swapper/107:29:061
609399674,57cyclictest0-21swapper/310:06:063
609399673,57cyclictest15553-21mailstats09:46:213
609299673,58cyclictest0-21swapper/208:41:322
248599670,4rtkit-daemon2484-21rtkit-daemon09:02:362
609399664,15cyclictest0-21swapper/310:11:083
6090996635,9cyclictest2655-21hostname08:41:071
6090996625,23cyclictest20184-21rm08:17:251
609299654,55cyclictest0-21swapper/210:23:272
609299654,54cyclictest0-21swapper/209:51:182
609299653,55cyclictest0-21swapper/209:41:232
6090996540,9cyclictest2800-21ls07:51:271
6090996540,9cyclictest2800-21ls07:51:271
6090996538,12cyclictest0-21swapper/109:31:231
6090996537,12cyclictest0-21swapper/107:46:171
6090996519,26cyclictest24415-21cpuspeed06:46:111
609299645,52cyclictest6516-21diskstats08:46:102
609299644,54cyclictest0-21swapper/207:56:092
609299643,54cyclictest0-21swapper/209:45:522
609299642,55cyclictest0-21swapper/208:56:252
6090996438,11cyclictest0-21swapper/108:21:161
609299635,51cyclictest0-21swapper/209:21:062
609299633,54cyclictest0-21swapper/207:46:162
609299633,51cyclictest5838-21crond07:10:572
609299632,53cyclictest0-21swapper/207:16:212
609099635,18cyclictest0-21swapper/108:38:301
6090996339,8cyclictest2513-21udisks-daemon10:11:191
6090996334,11cyclictest0-21swapper/107:07:431
6090996333,13cyclictest0-21swapper/109:11:571
6090996333,10cyclictest0-21swapper/107:17:141
1499826310,9sleep114053-21munin-node09:46:131
609399626,47cyclictest7552-21timerandwakeup08:46:273
609399625,51cyclictest0-21swapper/309:30:523
609399625,27cyclictest0-21swapper/306:45:253
609399624,13cyclictest0-21swapper/308:06:193
6093996221,13cyclictest0-21swapper/309:04:053
609299624,52cyclictest0-21swapper/209:36:462
609299624,52cyclictest0-21swapper/207:26:162
6092996237,9cyclictest31573-21telnet08:36:052
609299623,53cyclictest0-21swapper/206:44:072
609299622,52cyclictest0-21swapper/207:31:122
6090996235,12cyclictest0-21swapper/108:01:171
6090996234,12cyclictest0-21swapper/110:06:021
6090996232,8cyclictest8459-21latency09:36:151
6090996231,12cyclictest26235-21sendmail_mailqu08:26:221
6090996230,12cyclictest0-21swapper/110:20:201
6090996228,15cyclictest0-21swapper/108:33:261
6090996228,12cyclictest0-21swapper/107:23:561
248599620,4rtkit-daemon2484-21rtkit-daemon05:01:152
609399615,27cyclictest0-21swapper/309:55:013
609399615,27cyclictest0-21swapper/307:57:373
609399614,49cyclictest0-21swapper/306:46:213
609399614,28cyclictest0-21swapper/308:55:543
6093996121,13cyclictest0-21swapper/305:01:293
6093996119,13cyclictest26154-21telnet09:16:023
6093996119,13cyclictest26154-21telnet09:16:023
6093996119,13cyclictest0-21swapper/307:35:363
609299614,51cyclictest0-21swapper/209:17:182
609299614,51cyclictest0-21swapper/209:17:182
609299614,50cyclictest0-21swapper/210:11:172
6092996138,8cyclictest24750-21ssh10:01:062
609299613,52cyclictest0-21swapper/209:11:112
609299612,53cyclictest0-21swapper/209:28:022
6090996135,12cyclictest0-21swapper/110:21:141
6090996132,11cyclictest0-21swapper/108:06:251
293762613,12sleep20-21swapper/205:46:352
609399605,27cyclictest0-21swapper/309:11:023
609399605,27cyclictest0-21swapper/307:41:213
609399605,26cyclictest0-21swapper/308:14:253
609399604,27cyclictest0-21swapper/307:55:453
609399604,27cyclictest0-21swapper/307:55:453
609299605,48cyclictest0-21swapper/206:46:112
609299604,50cyclictest0-21swapper/210:26:132
609299604,50cyclictest0-21swapper/208:26:082
609299604,49cyclictest0-21swapper/207:11:142
609299604,49cyclictest0-21swapper/207:11:142
609299604,37cyclictest0-21swapper/205:31:142
6090996027,12cyclictest30919-21processes09:21:201
166052603,10sleep10-21swapper/108:11:351
609399596,24cyclictest24455-21iostat07:36:183
609399595,25cyclictest20794-21munin-node09:56:113
609399595,25cyclictest20794-21munin-node09:56:113
609399594,49cyclictest0-21swapper/305:26:163
609399594,48cyclictest0-21swapper/309:06:223
609399594,11cyclictest0-21swapper/309:25:523
609399594,11cyclictest0-21swapper/306:18:413
609299595,47cyclictest20471-21iostat_ios09:06:152
609299594,49cyclictest0-21swapper/207:36:272
609299593,51cyclictest0-21swapper/206:21:222
609299593,50cyclictest15005-21uptime07:21:322
609299593,50cyclictest0-21swapper/209:30:592
609299592,50cyclictest0-21swapper/205:11:142
609299592,50cyclictest0-21swapper/205:11:142
6090995932,13cyclictest0-21swapper/109:44:281
6090995928,15cyclictest0-21swapper/105:56:121
6090995926,15cyclictest0-21swapper/108:46:071
316222594,12sleep20-21swapper/205:51:312
316222594,12sleep20-21swapper/205:51:312
609399585,29cyclictest0-21swapper/307:11:293
609399585,29cyclictest0-21swapper/307:11:293
609399585,26cyclictest0-21swapper/308:22:123
609399584,49cyclictest0-21swapper/308:59:163
609399584,48cyclictest0-21swapper/307:22:333
609299584,48cyclictest0-21swapper/207:00:582
609299584,48cyclictest0-21swapper/205:16:342
6090995831,13cyclictest0-21swapper/107:03:141
6090995831,12cyclictest0-21swapper/105:26:101
609099583,49cyclictest0-21swapper/106:56:211
6090995829,14cyclictest0-21swapper/106:31:301
6090995829,14cyclictest0-21swapper/106:31:301
6090995828,15cyclictest0-21swapper/109:20:191
6090995828,15cyclictest0-21swapper/109:20:191
6090995825,9cyclictest23404-21munin-node07:36:271
6085995811,41cyclictest19652-21timerandwakeup08:16:260
609399575,30cyclictest0-21swapper/307:07:273
6092995733,8cyclictest21851-21ssh09:56:132
6092995733,8cyclictest21851-21ssh09:56:132
609099575,34cyclictest0-21swapper/107:11:091
609099575,34cyclictest0-21swapper/107:11:091
6090995735,9cyclictest0-21swapper/107:34:451
6090995732,12cyclictest0-21swapper/109:51:161
6090995731,12cyclictest0-21swapper/105:51:301
6090995731,12cyclictest0-21swapper/105:51:301
609099573,47cyclictest0-21swapper/109:30:521
6090995716,24cyclictest16577-21fschecks_time05:21:171
6090995712,29cyclictest0-21swapper/108:59:161
608599575,44cyclictest0-21swapper/008:26:230
608599573,48cyclictest0-21swapper/008:49:510
609399564,27cyclictest0-21swapper/308:44:163
609399564,27cyclictest0-21swapper/308:20:553
609399563,12cyclictest0-21swapper/306:01:283
6093995619,15cyclictest0-21swapper/310:20:563
609299564,46cyclictest0-21swapper/208:08:092
609299564,45cyclictest0-21swapper/208:11:062
609299563,48cyclictest0-21swapper/208:19:022
609299563,48cyclictest0-21swapper/208:05:382
6092995625,15cyclictest0-21swapper/207:41:102
6090995631,12cyclictest0-21swapper/110:01:311
6090995631,11cyclictest0-21swapper/106:06:191
6090995618,13cyclictest27670-21cut07:41:161
6090995618,12cyclictest0-21swapper/108:51:071
6090995618,12cyclictest0-21swapper/105:01:121
6085995622,13cyclictest0-21swapper/009:16:140
6085995622,13cyclictest0-21swapper/009:16:140
248599560,5rtkit-daemon2484-21rtkit-daemon05:26:142
609399554,13cyclictest0-21swapper/305:11:213
609399554,13cyclictest0-21swapper/305:11:213
6093995536,13cyclictest10552-21gltestperf07:16:173
609299553,48cyclictest0-21swapper/210:08:132
6092995526,13cyclictest0-21swapper/205:21:122
609299552,47cyclictest0-21swapper/206:06:162
6090995531,11cyclictest0-21swapper/109:02:061
609099553,45cyclictest0-21swapper/106:36:291
609099553,27cyclictest0-21swapper/106:25:591
609099553,25cyclictest0-21swapper/109:06:261
609099553,25cyclictest0-21swapper/105:16:021
609099553,25cyclictest0-21swapper/105:16:021
6090995523,15cyclictest0-21swapper/106:16:121
6090995523,14cyclictest0-21swapper/105:41:291
6085995527,20cyclictest13290-21ssh08:56:100
609399545,19cyclictest0-21swapper/308:31:253
609399544,12cyclictest0-21swapper/308:38:243
609399543,12cyclictest0-21swapper/309:31:573
609399542,10cyclictest0-21swapper/309:41:183
609299547,42cyclictest0-21swapper/205:36:122
6092995432,8cyclictest2722-21ssh07:51:262
6092995432,8cyclictest2722-21ssh07:51:262
6092995431,9cyclictest28068-21ssh08:30:552
609299543,46cyclictest0-21swapper/208:22:122
609299543,44cyclictest0-21swapper/207:01:282
609099544,24cyclictest15631-21munin-run05:21:011
609099543,45cyclictest0-21swapper/106:51:321
6090995426,13cyclictest0-21swapper/106:01:101
608599544,42cyclictest0-21swapper/008:11:260
248599540,5rtkit-daemon2484-21rtkit-daemon05:56:362
93992532,44sleep00-21swapper/006:13:220
609399534,11cyclictest16739-21aten_r1power_fr07:26:083
609399534,10cyclictest0-21swapper/310:01:223
609399532,9cyclictest0-21swapper/308:04:383
6092995328,9cyclictest17011-21munin-node06:31:192
6092995328,9cyclictest17011-21munin-node06:31:192
609299532,44cyclictest0-21swapper/206:11:172
609099535,41cyclictest0-21swapper/105:46:211
6090995324,14cyclictest0-21swapper/105:06:331
6090995324,14cyclictest0-21swapper/105:06:331
6090995324,13cyclictest0-21swapper/106:41:141
608599534,43cyclictest0-21swapper/007:34:400
6085995312,13cyclictest0-21swapper/009:36:240
321882532,45sleep00-21swapper/005:54:030
321882532,45sleep00-21swapper/005:54:030
30602534,41sleep20-21swapper/206:01:152
304502536,41sleep00-21swapper/010:10:100
248599530,5rtkit-daemon2484-21rtkit-daemon06:36:262
248599530,5rtkit-daemon2484-21rtkit-daemon06:26:122
248599530,5rtkit-daemon2484-21rtkit-daemon06:16:352
609399524,12cyclictest0-21swapper/307:01:283
609399524,11cyclictest0-21swapper/308:28:183
609399523,8cyclictest27487-21idleruntime06:51:183
6093995212,26cyclictest0-21swapper/309:37:243
609099524,24cyclictest0-21swapper/106:26:091
609099523,25cyclictest8051-21grep06:11:151
6090995216,18cyclictest0-21swapper/105:40:141
6085995223,13cyclictest0-21swapper/009:31:190
6085995210,8cyclictest0-21swapper/009:09:350
224562523,42sleep10-21swapper/105:31:511
609399514,23cyclictest0-21swapper/310:16:493
609399514,12cyclictest0-21swapper/310:27:483
6093995133,8cyclictest26281-21gltestperf05:41:193
609399513,11cyclictest0-21swapper/305:35:143
6092995135,10cyclictest26603-21grep05:41:242
609299512,43cyclictest0-21swapper/206:51:122
608599514,40cyclictest0-21swapper/009:11:390
608599513,7cyclictest31110-21diskmemload07:56:130
6085995123,13cyclictest0-21swapper/007:26:130
6085995122,13cyclictest0-21swapper/008:45:530
6085995112,13cyclictest0-21swapper/009:41:080
248599510,5rtkit-daemon2484-21rtkit-daemon05:06:222
248599510,5rtkit-daemon2484-21rtkit-daemon05:06:222
236642513,41sleep00-21swapper/008:22:500
609399505,11cyclictest27945-21aten2.4-expect05:46:133
609399504,12cyclictest30222-21taskset05:51:113
609399504,12cyclictest30222-21taskset05:51:113
609399504,11cyclictest0-21swapper/306:31:253
609399504,11cyclictest0-21swapper/306:31:253
609399503,12cyclictest0-21swapper/305:11:013
609399503,12cyclictest0-21swapper/305:11:013
608599505,12cyclictest0-21swapper/009:56:150
608599505,12cyclictest0-21swapper/009:56:150
6085995022,13cyclictest0-21swapper/007:21:140
6085995017,28cyclictest1419-21runrttasks10:25:300
6085995013,22cyclictest1287-21snmpd10:26:020
269542503,41sleep00-21swapper/007:41:100
226632503,41sleep00-21swapper/005:34:320
120172503,41sleep012092-21iostat05:11:220
120172503,41sleep012092-21iostat05:11:220
609399495,26cyclictest0-21swapper/305:25:123
609399494,26cyclictest0-21swapper/306:25:593
609399494,26cyclictest0-21swapper/305:20:113
6093994935,8cyclictest20247-21cut06:36:173
6093994918,14cyclictest0-21swapper/306:56:283
608599498,10cyclictest7250irq/45-ahci05:31:010
608599495,37cyclictest0-21swapper/009:46:000
608599494,40cyclictest0-21swapper/007:12:590
608599494,40cyclictest0-21swapper/007:12:590
608599494,39cyclictest0-21swapper/009:26:150
608599494,29cyclictest0-21swapper/008:01:160
608599493,28cyclictest0-21swapper/008:51:110
6085994928,14cyclictest0-21swapper/005:36:290
6085994922,12cyclictest0-21swapper/009:21:130
6085994921,12cyclictest0-21swapper/010:01:240
609399484,39cyclictest8314-21gltestperf06:11:173
609399484,26cyclictest0-21swapper/306:10:193
609399484,15cyclictest0-21swapper/306:30:593
609399483,27cyclictest23015-21munin-node05:36:203
608599486,25cyclictest0-21swapper/005:46:170
608599485,36cyclictest0-21swapper/007:36:180
6085994821,12cyclictest0-21swapper/009:01:210
6085994821,12cyclictest0-21swapper/007:01:120
6085994820,12cyclictest0-21swapper/005:46:000
609399474,26cyclictest0-21swapper/306:00:153
608599473,39cyclictest31668-21python07:46:300
608599473,39cyclictest0-21swapper/006:41:090
608599473,37cyclictest27407-21sed06:51:170
608599473,27cyclictest0-21swapper/007:16:120
608599473,11cyclictest0-21swapper/006:16:140
6085994727,13cyclictest0-21swapper/010:16:030
6085994726,14cyclictest0-21swapper/006:31:250
6085994726,14cyclictest0-21swapper/006:31:250
6085994722,11cyclictest0-21swapper/005:06:300
6085994722,11cyclictest0-21swapper/005:06:300
6085994720,12cyclictest0-21swapper/005:26:020
43472474,35sleep00-21swapper/004:56:240
609099464,36cyclictest0-21swapper/105:01:021
608599464,35cyclictest1419-21runrttasks06:01:300
6085994622,9cyclictest1247-21lldpd05:01:160
6085994622,8cyclictest21549-21turbostat06:40:580
6085994619,12cyclictest0-21swapper/009:51:100
6085994618,9cyclictest15626-21latency_hist05:21:020
6085994618,12cyclictest0-21swapper/006:06:230
6085994520,11cyclictest0-21swapper/006:21:210
260392452,38sleep00-21swapper/006:47:240
166102452,37sleep00-21swapper/006:28:540
608599443,33cyclictest32737-21telnet05:56:130
608599423,33cyclictest0-21swapper/006:58:280
609299404,21cyclictest6075-21munin-run05:01:022
609399333,24cyclictest0-21swapper/305:01:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional