You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-29 - 18:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Sun Mar 29, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1032699943,84cyclictest2046-21iostat_ios09:50:230
120102920,8sleep00-21swapper/006:40:200
1032699915,78cyclictest0-21swapper/008:00:310
1032699914,78cyclictest0-21swapper/010:00:160
1032699907,42cyclictest0-21swapper/010:35:190
1032699903,80cyclictest12914-21grep10:05:330
1032699884,77cyclictest0-21swapper/008:10:350
1032699867,72cyclictest0-21swapper/010:45:320
1032699864,74cyclictest0-21swapper/007:30:190
1032699864,62cyclictest0-21swapper/010:54:570
1032699863,60cyclictest19901-21ssh09:30:030
1032699854,74cyclictest0-21swapper/009:47:320
1032699854,74cyclictest0-21swapper/009:47:320
1032699854,44cyclictest0-21swapper/009:07:240
1032699854,44cyclictest0-21swapper/009:07:240
1032699847,53cyclictest0-21swapper/009:35:230
1032699836,59cyclictest0-21swapper/007:55:380
1032699833,50cyclictest11961-21kworker/0:108:45:280
1032699824,71cyclictest0-21swapper/007:45:200
1032699823,61cyclictest28916-21cpuspeed08:55:140
1032699813,57cyclictest0-21swapper/008:35:310
1032699813,53cyclictest257811ssh10:25:220
1032699813,53cyclictest257811ssh10:25:220
1032699804,69cyclictest0-21swapper/010:40:080
1032699804,69cyclictest0-21swapper/010:21:540
1032699804,68cyclictest0-21swapper/009:02:280
1032699803,69cyclictest0-21swapper/009:25:170
1032699803,69cyclictest0-21swapper/008:43:370
1032699803,54cyclictest0-21swapper/009:56:020
10326998026,49cyclictest29243-21head10:30:230
10326998020,43cyclictest0-21swapper/008:25:130
10326998020,43cyclictest0-21swapper/008:25:130
1032699797,53cyclictest0-21swapper/008:31:550
1032699794,68cyclictest0-21swapper/009:10:200
1032699794,68cyclictest0-21swapper/006:45:330
1032699793,56cyclictest26892-21cpuspeed09:40:130
1032699785,57cyclictest0-21swapper/007:35:200
1032699783,67cyclictest0-21swapper/008:20:200
1032699783,54cyclictest1287-21snmpd10:15:290
1032699783,48cyclictest0-21swapper/006:50:200
1032699774,66cyclictest11464-21idleruntime-cro06:40:070
1032699773,68cyclictest9826-21munin-node09:15:310
1032699773,68cyclictest0-21swapper/008:54:580
1032699773,66cyclictest0-21swapper/007:16:450
1032699772,45cyclictest12972-21sh10:55:110
10329997626,42cyclictest21411-21gltestperf07:55:253
1032699764,65cyclictest0-21swapper/007:10:240
1032699764,55cyclictest0-21swapper/007:50:370
1032699763,56cyclictest0-21swapper/008:06:240
1032699762,57cyclictest0-21swapper/009:20:450
10326997617,41cyclictest0-21swapper/008:15:180
10326997617,39cyclictest0-21swapper/010:11:370
1032699756,62cyclictest0-21swapper/007:20:290
1032699754,36cyclictest0-21swapper/007:40:200
1032699754,36cyclictest0-21swapper/007:40:200
1032699753,64cyclictest18987-21aten2.4-expect06:55:200
1032699753,64cyclictest1287-21snmpd05:49:060
10326997529,40cyclictest13275-21cpuspeed_turbos05:35:230
10326997529,40cyclictest13275-21cpuspeed_turbos05:35:230
10326997515,45cyclictest24650-21munin-run06:00:080
10329997423,41cyclictest21314-21runrttasks05:50:343
1032699735,52cyclictest0-21swapper/006:25:070
1032699735,52cyclictest0-21swapper/006:25:070
1032699734,63cyclictest0-21swapper/005:50:290
1032699733,63cyclictest1419-21runrttasks06:10:180
1032699733,62cyclictest0-21swapper/006:00:230
10329997225,41cyclictest14964-21gltestperf06:45:263
10329997223,42cyclictest7562-21munin-run09:59:593
1032699724,60cyclictest0-21swapper/007:04:480
1032699724,60cyclictest0-21swapper/007:04:480
10326997231,35cyclictest23754-21aten2.4-expect07:05:170
1032699723,63cyclictest0-21swapper/005:30:460
1032699723,62cyclictest0-21swapper/006:15:280
1032699723,52cyclictest0-21swapper/006:30:190
10326997224,41cyclictest1374-21fschecks_count07:25:230
1032699713,61cyclictest0-21swapper/006:05:270
10329997024,36cyclictest17259-21ssh08:36:113
10326997031,34cyclictest6211-21grep06:25:410
1032699703,52cyclictest0-21swapper/005:44:050
10329996922,30cyclictest1656-21telnet08:15:133
10329996913,46cyclictest31812-21load08:10:273
10329996824,36cyclictest12358-21latency_hist10:54:573
10329996822,37cyclictest29671-21aten_r1power_cu06:10:173
10329996821,40cyclictest15353-21nscd09:00:013
10329996821,33cyclictest1686-21nscd07:50:043
10329996820,39cyclictest14761-21switchtime09:20:333
10329996820,25cyclictest1419-21runrttasks07:30:383
10329996817,43cyclictest0-21swapper/310:30:133
10329996814,32cyclictest0-21swapper/310:00:193
10329996721,37cyclictest21275-21ssh10:20:073
10329996720,40cyclictest0-21swapper/308:50:303
10329996717,43cyclictest0-21swapper/306:00:203
10329996715,46cyclictest0-21swapper/309:01:143
10329996713,31cyclictest26665-21rm09:40:103
1032999665,39cyclictest0-21swapper/308:45:313
10329996619,24cyclictest3066-21diskmemload09:15:143
10329996617,43cyclictest0-21swapper/307:40:193
10329996617,43cyclictest0-21swapper/307:40:193
10329996616,29cyclictest0-21swapper/308:00:523
10329996611,47cyclictest0-21swapper/308:31:063
10329996520,38cyclictest1419-21runrttasks06:07:263
10329996517,38cyclictest0-21swapper/308:20:183
10329996516,41cyclictest2966-21munin-node09:50:363
10329996516,32cyclictest11488-21cpuspeed_turbos10:05:133
1032899654,30cyclictest0-21swapper/210:14:152
248599640,22rtkit-daemon0-21swapper/106:47:491
1032999645,38cyclictest0-21swapper/307:00:213
1032999645,38cyclictest0-21swapper/307:00:213
1032999643,54cyclictest0-21swapper/308:43:493
10329996422,22cyclictest0-21swapper/309:46:573
10329996422,22cyclictest0-21swapper/309:46:573
10329996421,37cyclictest1676-21nscd07:38:153
10329996420,20cyclictest31957-21ssh10:35:143
10329996416,41cyclictest0-21swapper/310:25:153
10329996416,41cyclictest0-21swapper/310:25:153
10329996416,41cyclictest0-21swapper/310:15:123
10329996416,41cyclictest0-21swapper/308:05:143
10329996412,44cyclictest0-21swapper/309:11:023
10329996411,45cyclictest0-21swapper/310:13:543
10329996318,38cyclictest0-21swapper/307:10:183
10329996318,36cyclictest20976-21sshd06:59:413
10329996316,27cyclictest3066-21diskmemload09:26:193
10329996315,42cyclictest0-21swapper/308:27:423
10329996315,42cyclictest0-21swapper/308:27:423
10329996314,43cyclictest0-21swapper/307:51:143
10329996314,41cyclictest0-21swapper/306:30:083
1032899634,52cyclictest0-21swapper/208:00:222
1032699634,52cyclictest0-21swapper/005:30:090
10329996215,41cyclictest0-21swapper/310:55:143
10329996212,43cyclictest0-21swapper/310:45:343
10329996211,43cyclictest0-21swapper/310:40:143
1032799624,51cyclictest0-21swapper/108:54:351
1032999616,47cyclictest0-21swapper/305:36:443
1032999616,47cyclictest0-21swapper/305:36:443
10329996138,16cyclictest0-21swapper/309:35:343
1032999613,52cyclictest0-21swapper/309:31:243
10327996144,10cyclictest6000-21gltestperf08:20:211
10329996041,12cyclictest17635-21munin-node06:50:313
1032999604,31cyclictest0-21swapper/307:25:223
1032799604,21cyclictest29541-21cut08:55:211
10329995919,11cyclictest4483-21ps09:05:293
10329995919,11cyclictest4483-21ps09:05:293
10329995917,27cyclictest18280-21df_inode05:45:233
10329995910,41cyclictest8185-21munin-node06:30:333
93212583,11sleep20-21swapper/209:14:132
172052584,45sleep20-21swapper/208:35:592
1032899584,48cyclictest0-21swapper/209:42:552
10328995836,15cyclictest0-21swapper/209:50:182
10329995727,21cyclictest11293-21runrttasks05:30:273
10329995717,26cyclictest16218-21hddtemp_smartct05:40:283
10329995713,37cyclictest0-21swapper/306:00:033
10329995710,39cyclictest2765-21fschecks_count06:20:263
10329995710,39cyclictest2765-21fschecks_count06:20:263
1032999566,44cyclictest0-21swapper/307:15:173
10329995636,12cyclictest32438-21expr06:15:213
1032899564,35cyclictest0-21swapper/207:24:422
1032899564,27cyclictest0-21swapper/210:35:412
1032799565,31cyclictest0-21swapper/107:55:351
10327995621,25cyclictest6945-21df_abs09:10:161
85852552,10sleep10-21swapper/110:00:191
265062553,8sleep226559-21strings08:50:262
152732554,42sleep10-21swapper/109:21:171
10329995533,16cyclictest11189-21runrttasks06:36:393
10329995515,33cyclictest1419-21runrttasks07:24:083
1032899554,44cyclictest0-21swapper/210:45:482
10329995410,36cyclictest23633-21munin-node07:05:313
1032899546,41cyclictest26-21rcuc/207:40:042
1032899544,23cyclictest0-21swapper/209:15:162
1032899543,45cyclictest0-21swapper/209:36:382
1032899543,45cyclictest0-21swapper/207:44:592
1032899543,45cyclictest0-21swapper/207:44:592
1032799544,30cyclictest0-21swapper/107:30:321
1032799544,26cyclictest12922-21iostat_ios08:30:251
10327995438,10cyclictest2088-21runrttasks09:50:251
10327995412,24cyclictest19477-21gltestperf08:40:201
17692534,12sleep20-21swapper/209:01:392
1032899534,35cyclictest0-21swapper/209:34:002
1032899534,33cyclictest0-21swapper/210:16:112
1032899534,12cyclictest0-21swapper/208:10:172
10328995337,9cyclictest18900-21grep08:40:142
10328995334,11cyclictest13623-21grep08:30:362
1032799533,37cyclictest0-21swapper/105:57:421
10327995321,13cyclictest17905-21munin-node10:15:191
280492522,9sleep20-21swapper/207:13:362
267912522,10sleep10-21swapper/108:04:181
10329995218,27cyclictest12552-21cut06:40:263
1032899527,9cyclictest11890-21sh10:05:182
1032899524,41cyclictest0-21swapper/209:45:252
1032899524,41cyclictest0-21swapper/209:45:252
10328995231,14cyclictest0-21swapper/208:55:182
10328995230,15cyclictest0-21swapper/210:30:122
10328995220,26cyclictest14935-21netstat07:45:302
1032899522,43cyclictest0-21swapper/209:05:292
1032899522,43cyclictest0-21swapper/209:05:292
1032799525,21cyclictest0-21swapper/110:53:381
1032799525,13cyclictest0-21swapper/108:37:401
1032799524,29cyclictest0-21swapper/107:05:251
10327995222,13cyclictest0-21swapper/108:15:301
10327995221,12cyclictest0-21swapper/109:20:021
10327995212,10cyclictest15384-21gltestperf10:10:181
10327995210,37cyclictest201ktimersoftd/109:45:241
10327995210,37cyclictest201ktimersoftd/109:45:241
291082512,10sleep20-21swapper/206:06:212
114562513,12sleep20-21swapper/206:40:072
1032899514,41cyclictest26-21rcuc/210:25:102
1032899514,41cyclictest26-21rcuc/210:25:102
1032899514,29cyclictest0-21swapper/210:59:562
1032899513,42cyclictest0-21swapper/209:27:452
1032899513,41cyclictest0-21swapper/207:50:252
1032899513,31cyclictest0-21swapper/208:26:532
1032899513,31cyclictest0-21swapper/208:26:532
1032899512,42cyclictest0-21swapper/207:28:212
1032799515,38cyclictest0-21swapper/109:41:101
1032799514,30cyclictest0-21swapper/108:45:221
1032799514,29cyclictest0-21swapper/107:50:171
1032799514,27cyclictest0-21swapper/108:10:351
10327995123,9cyclictest12013-21ssh07:40:381
10327995123,9cyclictest12013-21ssh07:40:381
99932503,40sleep110079-21munin-node08:25:341
99932503,40sleep110079-21munin-node08:25:341
310242503,40sleep131075-21sendmail_mailtr06:10:351
1032899504,26cyclictest0-21swapper/207:31:162
10328995033,10cyclictest14396-21missed_timers09:20:252
1032899503,41cyclictest0-21swapper/210:44:262
1032799505,40cyclictest0-21swapper/110:28:401
1032799505,40cyclictest0-21swapper/110:28:401
1032799505,13cyclictest0-21swapper/109:29:541
1032799504,29cyclictest0-21swapper/109:30:161
1032799504,29cyclictest0-21swapper/105:30:211
1032799504,28cyclictest0-21swapper/106:50:291
1032799504,27cyclictest0-21swapper/110:20:561
1032799504,23cyclictest0-21swapper/109:08:011
1032799504,23cyclictest0-21swapper/109:08:011
10327995030,14cyclictest0-21swapper/107:47:151
10327995020,12cyclictest0-21swapper/110:35:111
10328994931,11cyclictest8197-21grep10:00:142
1032899493,41cyclictest0-21swapper/208:23:042
10328994929,13cyclictest0-21swapper/208:17:062
1032899492,41cyclictest0-21swapper/209:55:322
1032799496,20cyclictest0-21swapper/106:10:081
1032799495,27cyclictest0-21swapper/109:55:171
1032799494,38cyclictest0-21swapper/107:35:271
1032799494,28cyclictest0-21swapper/110:45:201
1032799494,28cyclictest0-21swapper/106:20:291
1032799494,28cyclictest0-21swapper/106:20:291
1032799494,27cyclictest0-21swapper/110:55:221
1032799494,27cyclictest0-21swapper/109:03:261
1032799494,27cyclictest0-21swapper/107:20:061
1032799494,27cyclictest0-21swapper/106:40:291
1032799494,27cyclictest0-21swapper/106:00:271
1032799494,26cyclictest0-21swapper/105:30:101
10327994925,10cyclictest0-21swapper/110:43:241
100152494,6sleep30-21swapper/305:26:373
1032899486,11cyclictest0-21swapper/208:45:232
1032899485,37cyclictest0-21swapper/210:20:292
1032899484,27cyclictest0-21swapper/206:15:232
1032899484,26cyclictest0-21swapper/206:30:082
10328994831,10cyclictest25370-21sed07:05:372
1032899483,39cyclictest0-21swapper/207:55:292
1032899483,28cyclictest0-21swapper/206:45:382
10328994826,8cyclictest26-21rcuc/210:50:342
1032799484,35cyclictest0-21swapper/110:30:091
1032799484,27cyclictest0-21swapper/109:36:241
1032799484,26cyclictest0-21swapper/110:08:561
1032799484,26cyclictest0-21swapper/108:08:531
1032799484,26cyclictest0-21swapper/107:25:231
1032799484,26cyclictest0-21swapper/105:45:391
208752472,9sleep20-21swapper/206:58:252
1032899474,26cyclictest0-21swapper/205:40:312
1032899473,38cyclictest0-21swapper/208:07:552
1032799473,24cyclictest0-21swapper/105:35:211
1032799473,24cyclictest0-21swapper/105:35:211
10327994717,11cyclictest26079-21aten_r1power_en07:10:171
1032899463,36cyclictest23146-21fschecks_count05:55:282
1032799465,35cyclictest0-21swapper/106:35:171
1032799464,25cyclictest0-21swapper/106:26:491
1032799464,12cyclictest0-21swapper/105:51:431
10327994619,9cyclictest22382-21missed_timers07:00:301
10327994619,9cyclictest22382-21missed_timers07:00:301
1032899455,34cyclictest0-21swapper/207:15:312
1032899454,25cyclictest0-21swapper/206:24:122
1032899454,25cyclictest0-21swapper/206:24:122
1032899453,26cyclictest0-21swapper/205:45:252
10328994522,17cyclictest12951-21nfs_client06:40:322
1032799454,36cyclictest0-21swapper/105:40:441
1032799454,25cyclictest0-21swapper/107:24:221
10327994532,9cyclictest0-21swapper/106:55:391
1032899448,6cyclictest26-21rcuc/206:14:102
1032899447,32cyclictest0-21swapper/206:30:192
1032899443,24cyclictest0-21swapper/205:51:432
1032799444,25cyclictest0-21swapper/106:15:181
1032799444,13cyclictest0-21swapper/106:30:231
1032899434,32cyclictest0-21swapper/205:30:202
1032899433,35cyclictest21407-21head07:00:182
1032899433,35cyclictest21407-21head07:00:182
1032899423,23cyclictest0-21swapper/206:51:412
10328994215,8cyclictest121850irq/46-eth006:00:242
99402414,30sleep20-21swapper/205:25:402
1032899412,15cyclictest0-21swapper/205:35:202
1032899412,15cyclictest0-21swapper/205:35:202
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional