You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-08 - 19:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Thu Jan 08, 2026 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3140699994,27cyclictest0-21swapper/007:10:250
3140699984,26cyclictest0-21swapper/008:05:130
233222980,5sleep123321-21basename07:35:281
3140699964,29cyclictest0-21swapper/010:20:370
3140699964,29cyclictest0-21swapper/010:20:370
31406999616,13cyclictest0-21swapper/006:55:350
3140699944,28cyclictest0-21swapper/009:25:410
3140699944,24cyclictest0-21swapper/009:15:220
31406999418,13cyclictest0-21swapper/007:15:250
31406999334,50cyclictest16144-21tune2fs08:30:310
31406999221,13cyclictest0-21swapper/010:50:240
3140799913,81cyclictest26049-21sort11:15:061
3140699904,27cyclictest0-21swapper/012:00:040
3140699904,27cyclictest0-21swapper/010:15:290
3140699904,27cyclictest0-21swapper/009:56:270
31406999024,57cyclictest6555-21aten_r1power_en07:00:270
31406999021,10cyclictest502-21tail09:05:290
3140799893,79cyclictest13071-21fschecks_count09:35:231
3140699894,27cyclictest0-21swapper/008:10:250
3140699894,27cyclictest0-21swapper/008:10:250
3140699894,15cyclictest0-21swapper/011:30:260
31406998932,48cyclictest14790-21unixbench_singl08:25:450
31406998916,66cyclictest32579-21unixbench-2d11:25:360
3140699885,14cyclictest9002-21taskset08:15:300
3140699884,78cyclictest0-21swapper/011:20:160
3140699884,77cyclictest0-21swapper/007:25:450
3140699884,77cyclictest0-21swapper/007:25:450
31406998824,57cyclictest3814-21cpuspeed_turbos08:05:270
3140699875,26cyclictest0-21swapper/010:08:420
3140699874,27cyclictest0-21swapper/007:20:460
3140699874,26cyclictest0-21swapper/008:43:280
3140699874,24cyclictest0-21swapper/009:40:210
248599870,5rtkit-daemon11046-21timerwakeupswit10:40:390
3140799863,74cyclictest0-21swapper/106:45:411
3140699866,13cyclictest1419-21runrttasks09:37:160
3140699864,75cyclictest0-21swapper/011:35:280
3140699864,28cyclictest0-21swapper/007:30:450
3140699864,27cyclictest0-21swapper/012:05:190
3140699864,27cyclictest0-21swapper/009:03:300
31406998634,43cyclictest4016-21unixbench_singl09:10:430
3140699855,27cyclictest0-21swapper/011:13:500
3140699854,63cyclictest0-21swapper/012:10:360
3140699854,26cyclictest0-21swapper/009:50:360
31406998525,52cyclictest0-21swapper/008:55:220
31406998525,52cyclictest0-21swapper/008:55:220
31406998514,12cyclictest0-21swapper/008:50:330
31406998514,12cyclictest0-21swapper/008:50:330
248599850,7rtkit-daemon11473-21gltestperf08:20:301
3140799844,44cyclictest0-21swapper/110:35:071
31406998431,46cyclictest23046-21df08:45:260
31406998424,52cyclictest1419-21runrttasks10:00:230
31406998416,13cyclictest0-21swapper/011:15:310
3140799834,71cyclictest0-21swapper/108:01:441
3140799833,73cyclictest0-21swapper/110:20:161
3140799833,73cyclictest0-21swapper/110:20:161
3140799833,72cyclictest7574-21unixbench_multi08:10:451
3140799833,72cyclictest7574-21unixbench_multi08:10:451
3140699835,17cyclictest0-21swapper/009:25:090
3140699834,71cyclictest0-21swapper/007:35:280
3140699834,28cyclictest0-21swapper/009:45:280
31406998317,8cyclictest12803-21latency_hist08:25:140
3140799824,71cyclictest0-21swapper/108:35:291
3140799824,70cyclictest0-21swapper/107:55:301
3140699824,70cyclictest0-21swapper/007:45:370
3140699824,27cyclictest0-21swapper/010:35:140
3140699824,26cyclictest0-21swapper/011:54:310
3140699824,26cyclictest0-21swapper/011:54:310
31406998211,14cyclictest0-21swapper/011:40:360
3140799814,70cyclictest0-21swapper/108:15:251
3140799814,70cyclictest0-21swapper/107:50:321
3140799813,72cyclictest0-21swapper/112:09:541
3140799813,71cyclictest1972-21cpuspeed_turbos06:50:301
3140799813,71cyclictest0-21swapper/110:40:191
3140699814,68cyclictest0-21swapper/011:45:140
3140699814,23cyclictest0-21swapper/011:00:180
3140699814,16cyclictest0-21swapper/010:45:370
31409998025,33cyclictest1419-21runrttasks07:00:533
3140799804,69cyclictest0-21swapper/112:00:151
3140799804,67cyclictest0-21swapper/107:25:461
3140799804,67cyclictest0-21swapper/107:25:461
3140799803,71cyclictest0-21swapper/111:25:181
3140799803,46cyclictest0-21swapper/108:25:291
3140699808,8cyclictest121850irq/46-eth010:55:170
3140699805,15cyclictest0-21swapper/007:55:430
3140699804,13cyclictest0-21swapper/008:35:420
3140699803,23cyclictest28912-21grep07:50:270
31406998019,8cyclictest0-21swapper/012:00:210
31406998018,12cyclictest0-21swapper/006:54:010
3140799794,67cyclictest0-21swapper/109:40:531
3140799794,60cyclictest0-21swapper/109:26:541
3140799793,69cyclictest0-21swapper/110:25:171
3140799793,69cyclictest0-21swapper/108:50:311
3140799793,69cyclictest0-21swapper/108:50:311
3140799793,68cyclictest32242-21munin-node09:05:221
3140799793,68cyclictest21069-21basename12:10:241
3140699794,25cyclictest4331-21grep10:25:200
3140699794,22cyclictest0-21swapper/010:10:280
3140699794,20cyclictest481-21jbd2/sda2-807:45:130
3140699794,12cyclictest0-21swapper/007:05:280
31406997915,13cyclictest0-21swapper/006:45:410
3140799784,68cyclictest0-21swapper/109:18:101
3140799784,67cyclictest0-21swapper/108:40:411
3140799784,66cyclictest0-21swapper/111:22:571
3140799783,69cyclictest9606-21fschecks_time07:05:341
3140799783,69cyclictest0-21swapper/111:05:051
3140799783,68cyclictest4176-21aten_r1power_fr06:55:271
3140799783,68cyclictest27052-21head07:45:291
3140799783,68cyclictest23450-21switchtime09:55:391
31409997719,49cyclictest0-21swapper/307:45:183
3140799774,67cyclictest0-21swapper/108:30:511
3140799774,65cyclictest12521-21sshd07:10:401
3140799773,67cyclictest4239-21fschecks_time08:05:321
3140799773,67cyclictest0-21swapper/110:39:371
3140799773,66cyclictest11702-21munin-node11:50:271
3140799773,66cyclictest11702-21munin-node11:50:271
3140799773,43cyclictest0-21swapper/109:50:251
31406997714,13cyclictest0-21swapper/011:05:200
31406997714,13cyclictest0-21swapper/011:05:200
31409997632,36cyclictest1419-21runrttasks09:14:133
31409997627,39cyclictest32633-21sort07:55:463
31409997623,32cyclictest1287-21snmpd08:30:133
3140799764,66cyclictest0-21swapper/111:39:051
3140799764,65cyclictest0-21swapper/110:05:341
3140799764,64cyclictest0-21swapper/110:58:501
3140799763,67cyclictest0-21swapper/107:40:591
3140799763,67cyclictest0-21swapper/107:33:301
3140799763,66cyclictest30352-21head10:10:331
3140799763,66cyclictest1345-21df_abs11:30:191
3140799763,66cyclictest0-21swapper/110:55:001
3140799763,65cyclictest8234-21needreboot09:20:331
3140799763,59cyclictest0-21swapper/109:14:191
3140799763,44cyclictest0-21swapper/108:45:241
31409997526,28cyclictest2066-21missed_timers11:30:283
3140799753,65cyclictest15868-21cat07:20:151
3140799753,65cyclictest12037-21taskset09:33:201
3140799753,64cyclictest13404-21grep11:55:171
248599750,8rtkit-daemon0-21swapper/010:17:401
31409997429,38cyclictest24358-21unixbench_singl08:45:453
31409997428,38cyclictest13430-21idleruntime-cro07:15:143
3140799743,64cyclictest14146-21latency_hist10:50:071
3140699746,12cyclictest1419-21runrttasks10:30:520
3140699744,23cyclictest0-21swapper/009:35:090
31409997323,28cyclictest0-21swapper/312:13:473
31409997319,30cyclictest0-21swapper/310:52:503
3140799733,62cyclictest0-21swapper/107:23:401
31409997222,42cyclictest8038-21iostat_ios10:35:253
3140799724,61cyclictest30560-21perl09:00:291
3140799723,64cyclictest0-21swapper/111:15:191
3140799723,63cyclictest0-21swapper/111:49:591
3140799723,62cyclictest6590-21telnet07:00:271
3140799723,62cyclictest21681-21expr11:05:181
3140799723,62cyclictest21681-21expr11:05:181
31409997130,21cyclictest23232-21telnet07:35:273
31409997118,45cyclictest0-21swapper/308:55:113
31409997118,45cyclictest0-21swapper/308:55:113
31409997114,48cyclictest0-21swapper/308:27:383
3140799713,62cyclictest0-21swapper/110:01:301
3140799713,62cyclictest0-21swapper/109:45:281
31409997022,40cyclictest1287-21snmpd11:23:543
3140799704,60cyclictest0-21swapper/111:40:271
31409996928,34cyclictest10099-21fschecks_count09:25:273
31409996925,23cyclictest213581munin-node11:05:173
31409996925,23cyclictest213581munin-node11:05:173
31409996924,27cyclictest0-21swapper/311:45:043
31409996923,30cyclictest0-21swapper/311:38:563
31409996921,41cyclictest20173-21diskstats09:50:223
31409996918,32cyclictest0-21swapper/310:55:183
3140799693,51cyclictest0-21swapper/108:58:541
3140799693,51cyclictest0-21swapper/108:58:541
31409996831,15cyclictest1419-21runrttasks08:35:283
31409996827,34cyclictest22685-21runrttasks07:31:363
31409996822,29cyclictest0-21swapper/309:45:273
31409996819,35cyclictest0-21swapper/309:44:583
31409996812,49cyclictest0-21swapper/311:25:493
31409996725,25cyclictest29180-21diskstats07:50:303
31409996723,36cyclictest0-21swapper/308:10:133
31409996723,30cyclictest0-21swapper/309:05:123
31409996720,33cyclictest0-21swapper/308:20:133
31409996719,41cyclictest15932-21diskstats12:00:193
31409996623,30cyclictest30663-21cat10:10:393
31409996622,36cyclictest8084-21cat08:15:133
31409996622,36cyclictest8084-21cat08:15:133
31409996622,30cyclictest0-21swapper/308:40:413
31409996621,38cyclictest1243-21lldpd09:36:123
31409996610,49cyclictest0-21swapper/309:05:233
31409996526,25cyclictest3077-21python10:20:353
31409996526,25cyclictest3077-21python10:20:353
31409996523,34cyclictest1419-21runrttasks10:43:263
31409996521,30cyclictest0-21swapper/308:25:133
31409996520,30cyclictest0-21swapper/310:05:093
31409996516,31cyclictest0-21swapper/311:45:173
31409996422,24cyclictest4602-21diskstats10:25:233
31409996421,37cyclictest1625-21awk06:50:273
31409996420,30cyclictest0-21swapper/307:15:403
31409996324,32cyclictest0-21swapper/309:15:333
31409996322,25cyclictest21250-21cat11:05:073
31409996320,37cyclictest0-21swapper/307:42:353
31409996319,28cyclictest1419-21runrttasks09:32:433
31409996319,27cyclictest19448-21iostat07:25:353
31409996319,27cyclictest19448-21iostat07:25:353
31409996318,37cyclictest0-21swapper/312:00:053
31409996317,37cyclictest24120-21taskset09:59:583
95422620,13sleep23140899cyclictest11:45:322
31409996239,16cyclictest0-21swapper/310:15:423
31409996131,24cyclictest9030-21runrttasks09:23:153
31409996124,28cyclictest0-21swapper/307:09:323
31409996124,11cyclictest18051-21runrttasks07:23:263
31409996123,30cyclictest0-21swapper/312:09:363
31409996122,11cyclictest3260-21munin-run08:05:133
31409996119,34cyclictest6799-21munin-run10:35:073
31409996030,24cyclictest10887-21cpuspeed_turbos11:50:173
31409996030,24cyclictest10887-21cpuspeed_turbos11:50:173
3140799604,51cyclictest0-21swapper/106:45:161
3140799604,51cyclictest0-21swapper/106:45:161
31409995920,15cyclictest25404-21unixbench-2d11:10:383
304882594,15sleep030536-21pluginstate06:40:410
304882594,15sleep030536-21pluginstate06:40:410
31409995824,27cyclictest0-21swapper/307:00:013
31409995823,12cyclictest121850irq/46-eth008:55:223
31409995823,12cyclictest121850irq/46-eth008:55:223
31409995814,35cyclictest11853-21munin-node10:45:163
282192583,47sleep20-21swapper/207:48:202
3140899573,28cyclictest0-21swapper/209:45:332
3140999566,45cyclictest0-21swapper/306:49:173
31409995621,28cyclictest1419-21runrttasks10:06:353
3140899564,44cyclictest0-21swapper/210:15:232
31409995525,24cyclictest26557-21df11:15:193
3140899555,34cyclictest0-21swapper/210:25:282
234332543,12sleep20-21swapper/209:55:392
205262543,44sleep20-21swapper/209:50:272
31408995337,10cyclictest1052-21rsyslogd10:36:512
3140899524,30cyclictest0-21swapper/210:35:072
301962524,41sleep20-21swapper/211:20:382
231742524,40sleep20-21swapper/211:05:472
231742524,40sleep20-21swapper/211:05:472
162332522,10sleep20-21swapper/210:53:382
31409995131,15cyclictest0-21swapper/306:45:173
31409995131,15cyclictest0-21swapper/306:45:173
3140899514,30cyclictest0-21swapper/209:00:272
31408995136,9cyclictest574-21cut09:05:302
303612513,41sleep230409-21ntpdc10:10:342
139462512,9sleep20-21swapper/210:49:592
3140899504,29cyclictest0-21swapper/209:25:242
3140899504,28cyclictest0-21swapper/211:55:192
3140899504,28cyclictest0-21swapper/211:35:202
3140899504,28cyclictest0-21swapper/207:20:262
31408995021,12cyclictest0-21swapper/209:15:102
31408995019,13cyclictest0-21swapper/208:15:442
257912504,39sleep20-21swapper/208:50:302
257912504,39sleep20-21swapper/208:50:302
226622502,9sleep20-21swapper/207:31:192
148812503,41sleep20-21swapper/208:26:162
117592504,38sleep20-21swapper/211:50:282
117592504,38sleep20-21swapper/211:50:282
3140899498,23cyclictest0-21swapper/208:25:122
3140899494,27cyclictest0-21swapper/211:15:322
3140899494,27cyclictest0-21swapper/210:40:192
3140899494,27cyclictest0-21swapper/206:55:372
3140899494,25cyclictest0-21swapper/210:20:172
3140899494,25cyclictest0-21swapper/210:20:172
3140899494,12cyclictest0-21swapper/211:33:562
31408994937,7cyclictest29-21ksoftirqd/211:15:002
83912482,39sleep20-21swapper/207:02:012
38232482,39sleep20-21swapper/206:54:442
3140899489,22cyclictest0-21swapper/210:05:242
3140899484,27cyclictest0-21swapper/209:40:292
3140899484,27cyclictest0-21swapper/209:20:252
3140899484,27cyclictest0-21swapper/207:10:282
3140899484,27cyclictest0-21swapper/206:45:332
3140899484,26cyclictest0-21swapper/211:25:172
3140899484,26cyclictest0-21swapper/208:55:282
3140899484,26cyclictest0-21swapper/208:55:282
3140899483,39cyclictest25075-21tune2fs10:00:262
253312482,9sleep20-21swapper/207:39:452
222832482,9sleep20-21swapper/208:44:132
6042472,9sleep20-21swapper/207:59:122
3140899474,27cyclictest0-21swapper/211:00:212
3140899474,26cyclictest0-21swapper/212:09:482
3140899474,26cyclictest0-21swapper/209:35:312
3140899474,26cyclictest0-21swapper/208:35:412
31408994733,8cyclictest30753-21crond07:55:132
31408994718,13cyclictest0-21swapper/207:28:162
31408994718,13cyclictest0-21swapper/207:28:162
31408994717,14cyclictest0-21swapper/207:43:202
78772462,10sleep20-21swapper/208:13:222
78772462,10sleep20-21swapper/208:13:222
3140899464,26cyclictest0-21swapper/211:40:142
3140899464,26cyclictest0-21swapper/210:55:342
3140899464,26cyclictest0-21swapper/209:20:102
3140899464,26cyclictest0-21swapper/208:30:472
3140899464,26cyclictest0-21swapper/208:05:252
306312464,7sleep20-21swapper/206:40:432
306312464,7sleep20-21swapper/206:40:432
157122462,9sleep20-21swapper/207:19:022
3140899458,21cyclictest0-21swapper/207:05:272
3140899454,33cyclictest0-21swapper/212:00:202
3140899454,25cyclictest0-21swapper/209:33:352
3140899453,26cyclictest0-21swapper/212:10:202
31408994517,12cyclictest0-21swapper/208:00:242
3140899444,13cyclictest0-21swapper/208:45:352
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional