You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-10 - 23:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackdslot4.osadl.org (updated Sat Jan 10, 2026 12:45:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
138591236168,23phc2sys0-21swapper/307:09:253
34582201167,23sleep10-21swapper/107:08:411
34862199167,21sleep20-21swapper/207:09:032
32732195162,21sleep00-21swapper/007:06:140
1733521210,3sleep2386199cyclictest11:55:192
3860996712,26cyclictest6042-21grep11:35:011
385999619,48cyclictest14099-21tr07:30:130
91332590,2sleep00-21swapper/011:40:130
3861995521,5cyclictest33-21ksoftirqd/212:07:412
3861995426,3cyclictest33-21ksoftirqd/210:45:182
385999544,16cyclictest20947-21latency_hist08:50:010
385999544,15cyclictest30817-21latency_hist10:15:010
3861995324,6cyclictest33-21ksoftirqd/209:25:172
1385915336,9phc2sys0-21swapper/307:10:003
3861995222,3cyclictest33-21ksoftirqd/208:00:272
385999525,17cyclictest1853-21/usr/sbin/munin10:20:180
323722510,2sleep232373-21ps12:25:252
138491510,0ptp4l401ktimersoftd/307:44:223
134991500,1getstats15606-1kworker/3:0H11:35:243
386199495,7cyclictest33-21ksoftirqd/211:45:232
386199492,6cyclictest33-21ksoftirqd/210:05:122
3861994918,4cyclictest33-21ksoftirqd/209:20:132
385999494,10cyclictest31588-21fschecks_time09:10:150
385999493,13cyclictest11252-21apt-get11:45:090
176742490,1sleep217673-21sed07:35:212
3861994825,7cyclictest33-21ksoftirqd/210:55:222
3861994819,5cyclictest33-21ksoftirqd/208:05:242
386199476,8cyclictest33-21ksoftirqd/209:05:142
386199476,5cyclictest33-21ksoftirqd/211:15:142
3861994728,9cyclictest33-21ksoftirqd/211:10:152
3860994727,17cyclictest25-21ksoftirqd/110:17:001
385999474,8cyclictest12277-21irqstats08:30:200
386199466,6cyclictest33-21ksoftirqd/212:30:152
386199465,6cyclictest33-21ksoftirqd/211:20:252
386199465,6cyclictest33-21ksoftirqd/211:20:252
386199465,5cyclictest33-21ksoftirqd/211:40:242
386199465,5cyclictest33-21ksoftirqd/208:10:162
386199465,5cyclictest33-21ksoftirqd/208:10:162
3861994642,2cyclictest311rcuc/208:30:212
3861994617,5cyclictest33-21ksoftirqd/210:33:112
385999464,11cyclictest25883-21/usr/sbin/munin11:10:150
386199456,8cyclictest33-21ksoftirqd/207:15:252
386199456,8cyclictest33-21ksoftirqd/207:15:242
386199456,6cyclictest33-21ksoftirqd/210:15:262
386199456,6cyclictest33-21ksoftirqd/207:20:232
386199455,7cyclictest33-21ksoftirqd/212:15:132
386199455,7cyclictest33-21ksoftirqd/210:50:232
386199455,7cyclictest33-21ksoftirqd/209:15:192
386199455,7cyclictest33-21ksoftirqd/208:50:142
386199455,6cyclictest33-21ksoftirqd/210:40:142
386199455,6cyclictest33-21ksoftirqd/207:50:132
386199453,5cyclictest33-21ksoftirqd/210:20:172
386199452,5cyclictest33-21ksoftirqd/208:40:192
385999454,7cyclictest16849-21df07:35:130
386199445,8cyclictest33-21ksoftirqd/207:25:192
386199445,7cyclictest33-21ksoftirqd/212:20:222
386199445,5cyclictest33-21ksoftirqd/208:20:132
386199443,5cyclictest33-21ksoftirqd/210:00:172
386199442,5cyclictest33-21ksoftirqd/211:30:172
386199442,5cyclictest321ktimersoftd/209:55:132
385999446,10cyclictest28327-21seq10:09:550
138491440,8ptp4l401ktimersoftd/308:46:363
386199436,7cyclictest33-21ksoftirqd/210:39:162
386199435,7cyclictest33-21ksoftirqd/208:35:122
386199435,7cyclictest33-21ksoftirqd/207:40:202
386199434,6cyclictest33-21ksoftirqd/209:39:552
386199433,8cyclictest33-21ksoftirqd/209:45:242
386199433,7cyclictest33-21ksoftirqd/211:35:112
386099431,30cyclictest16262-21apt-get09:45:121
385999434,16cyclictest19211-21iostat10:55:180
3862994224,3cyclictest8563-21cron08:25:013
386199426,6cyclictest33-21ksoftirqd/208:25:132
386199425,7cyclictest33-21ksoftirqd/209:10:252
386199424,7cyclictest33-21ksoftirqd/208:45:202
386199424,6cyclictest33-21ksoftirqd/211:25:192
386199424,5cyclictest33-21ksoftirqd/208:00:012
386199423,5cyclictest33-21ksoftirqd/212:00:112
386199422,9cyclictest33-21ksoftirqd/208:55:092
386199422,8cyclictest33-21ksoftirqd/210:25:152
386099421,28cyclictest0-21swapper/107:11:241
386099420,3cyclictest1828-21if_err_enp4s010:20:171
138491420,0ptp4l401ktimersoftd/311:55:073
3862994136,3cyclictest41-21ksoftirqd/312:34:593
386199415,7cyclictest33-21ksoftirqd/207:45:132
386199410,5cyclictest33-21ksoftirqd/208:15:212
153502410,1sleep30-21swapper/307:30:253
386199406,7cyclictest33-21ksoftirqd/209:40:142
386199406,6cyclictest33-21ksoftirqd/211:09:442
386199405,6cyclictest33-21ksoftirqd/212:35:152
386199405,6cyclictest33-21ksoftirqd/209:50:122
386199404,7cyclictest33-21ksoftirqd/207:10:212
386199402,7cyclictest33-21ksoftirqd/211:50:222
3860994034,3cyclictest21437-21wc07:45:131
385999403,7cyclictest22149-21iostat_ios07:45:180
385999402,7cyclictest8941-21df10:35:150
138491400,1ptp4l401ktimersoftd/307:35:173
3862993934,2cyclictest41-21ksoftirqd/310:59:593
386199393,3cyclictest33-21ksoftirqd/207:30:142
386199392,5cyclictest33-21ksoftirqd/210:10:152
385999393,9cyclictest27538-21ptp4l-jitter09:00:230
123282390,1sleep3391rcuc/311:45:183
3862993833,3cyclictest41-21ksoftirqd/312:40:003
3862993833,3cyclictest41-21ksoftirqd/310:35:003
3862993832,3cyclictest41-21ksoftirqd/310:15:183
386199382,7cyclictest33-21ksoftirqd/211:00:232
386199382,6cyclictest33-21ksoftirqd/212:11:412
385999384,7cyclictest484-21sshd12:25:570
385999382,11cyclictest0-21swapper/011:30:170
50798370,4rtkit-daemon32145-21meminfo12:25:213
3862993732,3cyclictest41-21ksoftirqd/310:20:123
3862993732,3cyclictest41-21ksoftirqd/309:25:003
386199375,6cyclictest33-21ksoftirqd/209:30:202
386199375,6cyclictest33-21ksoftirqd/209:30:202
386199371,8cyclictest33-21ksoftirqd/209:00:162
3860993731,4cyclictest25-21ksoftirqd/109:28:041
3860993730,5cyclictest25-21ksoftirqd/107:26:171
3860993715,19cyclictest8756-21sh11:40:011
386099370,5cyclictest14481-21ps09:40:161
385999374,17cyclictest0-21swapper/009:25:210
3859993726,9cyclictest9-21ksoftirqd/011:30:000
385999371,18cyclictest0-21swapper/011:20:200
385999371,18cyclictest0-21swapper/011:20:200
50798360,3rtkit-daemon242-21systemd-udevd10:02:073
3862993631,3cyclictest41-21ksoftirqd/309:55:163
3862993631,3cyclictest41-21ksoftirqd/309:01:583
3860993630,4cyclictest25-21ksoftirqd/108:24:351
3860993629,5cyclictest25-21ksoftirqd/109:39:071
3860993629,5cyclictest25-21ksoftirqd/109:21:021
3860993628,5cyclictest25-21ksoftirqd/112:05:461
3860993611,21cyclictest4058-21sed10:25:121
386099360,4cyclictest24908-21/usr/sbin/munin10:00:251
386099360,18cyclictest0-21swapper/111:10:141
385999365,17cyclictest31031-21cron08:05:010
385999364,13cyclictest6356-21apt-get08:20:110
385999362,17cyclictest0-21swapper/012:05:200
385999361,9cyclictest0-21swapper/012:22:590
385999360,9cyclictest0-21swapper/011:06:040
3862993530,3cyclictest41-21ksoftirqd/309:45:003
3862993530,3cyclictest41-21ksoftirqd/308:30:143
3862993530,3cyclictest41-21ksoftirqd/307:50:133
3862993529,4cyclictest41-21ksoftirqd/311:03:183
3862993529,4cyclictest41-21ksoftirqd/309:07:163
3860993530,3cyclictest25-21ksoftirqd/111:55:101
3860993529,4cyclictest25-21ksoftirqd/111:06:411
3860993529,4cyclictest25-21ksoftirqd/111:03:471
3860993529,4cyclictest25-21ksoftirqd/110:50:441
3860993529,4cyclictest25-21ksoftirqd/110:14:581
3860993528,5cyclictest25-21ksoftirqd/111:35:491
3860993528,5cyclictest25-21ksoftirqd/108:36:291
3860993512,21cyclictest20710-21awk07:40:261
3860993511,21cyclictest26134-21bc09:00:111
386099350,3cyclictest2472-21/usr/sbin/munin12:30:251
386099350,3cyclictest15520-21seq10:47:221
386099350,3cyclictest0-21swapper/107:20:121
385999354,9cyclictest1303-21runrttasks12:37:250
385999354,17cyclictest0-21swapper/011:55:160
3859993530,3cyclictest9-21ksoftirqd/010:47:180
3859993529,4cyclictest9-21ksoftirqd/008:14:180
3859993529,4cyclictest9-21ksoftirqd/008:14:180
385999352,17cyclictest0-21swapper/008:35:130
385999352,10cyclictest0-21swapper/008:55:210
3862993430,2cyclictest41-21ksoftirqd/307:20:133
3862993429,3cyclictest41-21ksoftirqd/309:36:533
3862993429,3cyclictest41-21ksoftirqd/308:35:173
3862993429,3cyclictest41-21ksoftirqd/307:55:173
3862993428,4cyclictest41-21ksoftirqd/311:16:333
3862993428,4cyclictest41-21ksoftirqd/307:45:043
3862993427,4cyclictest41-21ksoftirqd/311:24:323
3862993427,4cyclictest41-21ksoftirqd/311:24:323
3860993428,4cyclictest25-21ksoftirqd/111:50:341
3860993428,4cyclictest25-21ksoftirqd/110:56:251
3860993428,4cyclictest25-21ksoftirqd/110:43:381
3860993428,4cyclictest25-21ksoftirqd/110:08:441
3860993428,4cyclictest25-21ksoftirqd/108:28:271
3860993427,5cyclictest25-21ksoftirqd/110:30:541
3860993427,5cyclictest25-21ksoftirqd/109:07:221
3860993427,5cyclictest25-21ksoftirqd/108:57:191
3860993427,4cyclictest25-21ksoftirqd/111:23:541
3860993427,4cyclictest25-21ksoftirqd/111:23:531
3860993427,4cyclictest25-21ksoftirqd/111:18:381
386099342,27cyclictest31044-21apt-get12:25:131
386099342,25cyclictest28582-21apt-get12:20:111
3860993413,19cyclictest27656-21sed12:15:251
386099340,4cyclictest27058-21iostat07:55:161
386099340,3cyclictest6303-21sed08:20:001
386099340,3cyclictest18974-21cat08:45:121
3859993428,4cyclictest9-21ksoftirqd/010:34:220
3859993428,4cyclictest9-21ksoftirqd/009:45:480
3859993428,4cyclictest9-21ksoftirqd/009:18:240
3859993428,4cyclictest9-21ksoftirqd/008:08:000
385999340,18cyclictest0-21swapper/009:20:090
138491340,0ptp4l401ktimersoftd/312:19:593
3862993329,3cyclictest41-21ksoftirqd/309:15:193
3862993329,2cyclictest41-21ksoftirqd/310:25:173
3862993328,3cyclictest41-21ksoftirqd/310:54:593
3862993328,3cyclictest41-21ksoftirqd/308:09:543
3862993328,3cyclictest1319-21snmpd12:03:263
3862993327,4cyclictest41-21ksoftirqd/307:17:523
3862993327,4cyclictest41-21ksoftirqd/307:17:523
3860993328,3cyclictest25-21ksoftirqd/112:36:071
3860993328,3cyclictest25-21ksoftirqd/111:25:081
3860993327,4cyclictest25-21ksoftirqd/109:31:091
3860993327,4cyclictest25-21ksoftirqd/109:31:091
3860993327,4cyclictest25-21ksoftirqd/108:33:041
386099330,4cyclictest15075-21meminfo07:30:201
386099330,3cyclictest25834-21taskset07:51:481
386099330,2cyclictest8322sleep109:14:571
386099330,1cyclictest31993-21/usr/sbin/munin08:05:161
385999336,11cyclictest8702-21wc07:20:010
385999336,11cyclictest8702-21wc07:20:010
385999333,17cyclictest7192-21ls11:35:180
385999333,17cyclictest0-21swapper/007:55:170
3859993328,3cyclictest9-21ksoftirqd/010:15:100
3859993327,4cyclictest9-21ksoftirqd/012:15:360
3859993327,4cyclictest9-21ksoftirqd/007:44:450
385999331,19cyclictest0-21swapper/009:35:100
385999330,17cyclictest0-21swapper/009:40:110
3862993228,3cyclictest41-21ksoftirqd/312:24:593
3862993227,3cyclictest41-21ksoftirqd/311:31:223
3862993227,3cyclictest41-21ksoftirqd/311:30:013
3862993227,3cyclictest41-21ksoftirqd/311:11:213
3862993227,3cyclictest41-21ksoftirqd/310:35:243
3862993227,3cyclictest41-21ksoftirqd/308:30:003
3862993227,3cyclictest41-21ksoftirqd/308:15:513
3862993227,3cyclictest41-21ksoftirqd/308:04:503
3862993227,3cyclictest31019-21kworker/3:108:40:153
3862993226,4cyclictest41-21ksoftirqd/309:13:583
3860993226,4cyclictest25-21ksoftirqd/111:49:251
3860993226,4cyclictest25-21ksoftirqd/109:58:171
3860993226,4cyclictest25-21ksoftirqd/108:00:311
3860993226,4cyclictest25-21ksoftirqd/107:39:501
386099322,23cyclictest1329-21apt-get08:10:101
386099322,23cyclictest1329-21apt-get08:10:101
3860993211,19cyclictest19982-21phc2sys12:00:211
3860993210,19cyclictest8789-21mktemp07:20:001
3860993210,19cyclictest8789-21mktemp07:20:001
386099320,4cyclictest10409-21users10:35:291
386099320,3cyclictest223-21systemd-journal08:42:561
386099320,2cyclictest0-21swapper/109:15:001
385999324,10cyclictest25507-21timerandwakeup07:50:250
385999323,17cyclictest0-21swapper/008:25:190
3859993226,4cyclictest9-21ksoftirqd/011:01:140
3859993226,3cyclictest24145-21fschecks_count10:00:180
385999322,18cyclictest0-21swapper/009:30:220
385999322,18cyclictest0-21swapper/009:30:210
385999322,18cyclictest0-21swapper/007:20:240
385999322,18cyclictest0-21swapper/007:10:240
385999322,17cyclictest0-21swapper/007:25:240
385999322,10cyclictest0-21swapper/009:05:260
385999320,18cyclictest0-21swapper/010:40:120
3862993126,3cyclictest41-21ksoftirqd/310:45:183
3862993126,3cyclictest41-21ksoftirqd/309:30:143
3862993126,3cyclictest41-21ksoftirqd/309:30:143
3862993126,3cyclictest41-21ksoftirqd/308:15:003
3862993126,3cyclictest41-21ksoftirqd/308:15:003
3862993125,4cyclictest41-21ksoftirqd/309:49:323
3862993125,4cyclictest41-21ksoftirqd/308:58:103
3862993125,4cyclictest41-21ksoftirqd/307:29:083
3860993125,4cyclictest25-21ksoftirqd/112:10:031
3860993125,4cyclictest25-21ksoftirqd/108:53:541
3859993125,4cyclictest9-21ksoftirqd/009:56:360
3859993124,4cyclictest9-21ksoftirqd/012:10:060
385999310,18cyclictest0-21swapper/009:50:260
385999310,17cyclictest0-21swapper/010:50:120
138491310,0ptp4l401ktimersoftd/310:05:233
3862993024,4cyclictest41-21ksoftirqd/310:44:323
3862993024,4cyclictest41-21ksoftirqd/309:28:033
386099307,20cyclictest20237-21switchtime09:50:241
385999303,16cyclictest0-21swapper/012:30:180
385999303,16cyclictest0-21swapper/012:00:160
3859993024,4cyclictest9-21ksoftirqd/008:50:400
3859993024,4cyclictest9-21ksoftirqd/008:44:320
385999300,17cyclictest0-21swapper/011:15:130
3862992926,2cyclictest41-21ksoftirqd/308:55:003
3862992925,3cyclictest41-21ksoftirqd/310:15:013
3862992924,3cyclictest41-21ksoftirqd/311:10:003
3862992923,4cyclictest41-21ksoftirqd/309:50:493
385999292,16cyclictest0-21swapper/011:50:190
385999292,16cyclictest0-21swapper/010:25:130
385999291,17cyclictest0-21swapper/008:15:100
138491290,0ptp4l401ktimersoftd/311:42:043
3862992818,4cyclictest41-21ksoftirqd/312:10:273
138491280,0ptp4l401ktimersoftd/311:50:523
138491240,0ptp4l401ktimersoftd/312:09:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional