You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-21 - 23:51
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackdslot3.osadl.org (updated Tue Jul 21, 2026 12:45:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
38112236169,23sleep30-21swapper/307:06:353
38102207172,23sleep20-21swapper/207:06:332
40792204171,23sleep00-21swapper/007:09:570
40482203171,21sleep10-21swapper/107:09:341
2970221410,4sleep0437599cyclictest09:10:140
437599576,17cyclictest3089-21latency_hist08:15:000
437599573,18cyclictest0-21swapper/009:59:340
437599557,9cyclictest3202-21grep10:30:130
437599549,8cyclictest27459-21/usr/sbin/munin09:05:150
437599533,15cyclictest0-21swapper/009:30:140
437599533,14cyclictest0-21swapper/009:00:170
437599528,8cyclictest9464-21df_abs09:35:130
437799514,6cyclictest32534-21iwlist09:15:192
437599517,7cyclictest10410-21kernelversion11:50:200
437599517,17cyclictest6049-21hwlatdetect10:35:160
437599516,16cyclictest5831-21awk07:10:240
437599513,16cyclictest0-21swapper/008:20:230
4377995019,3cyclictest33-21ksoftirqd/209:03:372
437599504,15cyclictest0-21swapper/009:45:170
437599497,8cyclictest14626-21hddtemp_smartct07:30:180
437599497,8cyclictest14626-21hddtemp_smartct07:30:180
437599492,16cyclictest0-21swapper/012:35:190
437599487,9cyclictest21302-21ssh08:50:260
325832480,3sleep032587-21irqrtprio11:30:190
4376994718,27cyclictest0-21swapper/112:15:531
437599478,8cyclictest14738-21hddtemp_smartct12:00:180
437599473,15cyclictest0-21swapper/008:40:160
437599467,9cyclictest27397-21df11:20:140
437599466,7cyclictest6770-21apt-get07:15:110
437599465,7cyclictest23600-21apt-get07:50:100
437599463,7cyclictest31879-21ls08:05:230
4375994610,18cyclictest28714-21awk10:15:160
437799453,5cyclictest6650-21cat07:15:002
437599455,7cyclictest16244-21apt-get09:50:120
139391450,2ptp4l391rcuc/311:05:183
139391450,0ptp4l401ktimersoftd/311:00:203
4378994437,4cyclictest13654-21cron07:29:593
4376994438,3cyclictest18707-21cron12:10:001
437599447,7cyclictest26914-21if_err_enp1s012:25:190
437599447,7cyclictest17716-21df08:45:150
437599437,18cyclictest10566-21df10:45:120
437599436,7cyclictest29861-21diskstats11:25:160
437799426,5cyclictest33-21ksoftirqd/211:35:172
4377994220,3cyclictest33-21ksoftirqd/210:27:222
437599427,13cyclictest28858-21perl08:00:180
437599426,8cyclictest17249-21iostat_ios12:05:180
437599426,7cyclictest17511-21meminfo07:35:200
437599425,7cyclictest8470-21ls11:45:270
139391420,0ptp4l401ktimersoftd/309:45:193
139391420,0ptp4l401ktimersoftd/309:13:123
437799414,7cyclictest8141-21systemctl09:30:252
437599416,13cyclictest4402-21cpuspeed11:40:140
317492410,3sleep20-21swapper/212:35:162
139391410,34ptp4l0-21swapper/307:10:013
437599407,8cyclictest3298-21ps09:20:240
437599406,7cyclictest7941-21apt-get08:25:130
437599405,7cyclictest11804-21ls08:30:280
437599405,12cyclictest22828-21ls12:15:270
437599403,8cyclictest24676-21ls10:05:230
139391400,0ptp4l401ktimersoftd/307:52:203
4378993926,4cyclictest41-21ksoftirqd/309:21:573
437699393,4cyclictest0-21swapper/112:30:291
57898380,2rtkit-daemon577-21rtkit-daemon08:06:023
4377993828,9cyclictest33-21ksoftirqd/210:45:562
4377993813,6cyclictest33-21ksoftirqd/211:20:032
4378993731,4cyclictest1300-21snmpd09:02:143
4377993732,3cyclictest33-21ksoftirqd/211:15:122
4376993731,4cyclictest25-21ksoftirqd/109:27:561
4376993731,4cyclictest25-21ksoftirqd/108:40:481
4376993730,5cyclictest25-21ksoftirqd/112:21:471
4376993730,5cyclictest25-21ksoftirqd/109:42:081
4376993712,22cyclictest28042-21sshd10:14:461
437599376,11cyclictest25979-21cpu07:55:150
4378993631,3cyclictest41-21ksoftirqd/312:00:133
4377993626,9cyclictest33-21ksoftirqd/208:44:492
437799361,5cyclictest33-21ksoftirqd/207:40:132
4376993631,3cyclictest25-21ksoftirqd/110:41:341
4376993630,4cyclictest25-21ksoftirqd/110:24:461
4376993630,4cyclictest25-21ksoftirqd/110:24:451
4376993630,4cyclictest25-21ksoftirqd/109:23:441
4376993630,4cyclictest25-21ksoftirqd/109:14:241
4376993630,4cyclictest25-21ksoftirqd/108:39:061
4376993630,4cyclictest25-21ksoftirqd/108:14:161
4376993630,4cyclictest25-21ksoftirqd/108:05:091
4376993629,4cyclictest25-21ksoftirqd/111:00:471
4378993529,4cyclictest41-21ksoftirqd/312:25:383
4378993529,4cyclictest41-21ksoftirqd/310:53:583
4378993529,4cyclictest41-21ksoftirqd/307:41:243
4377993530,3cyclictest33-21ksoftirqd/207:55:132
4377993529,4cyclictest33-21ksoftirqd/210:37:262
4377993529,4cyclictest33-21ksoftirqd/209:29:062
4377993529,4cyclictest33-21ksoftirqd/208:25:282
437799352,8cyclictest33-21ksoftirqd/210:14:122
4376993529,4cyclictest25-21ksoftirqd/112:37:561
4376993529,4cyclictest25-21ksoftirqd/111:30:321
4376993529,4cyclictest25-21ksoftirqd/109:09:231
4376993512,21cyclictest14181-21sed10:50:261
437599353,7cyclictest17911-21hddtemp_smartct11:00:170
4378993429,3cyclictest41-21ksoftirqd/311:42:513
4378993429,3cyclictest41-21ksoftirqd/310:20:113
4378993429,3cyclictest41-21ksoftirqd/310:20:113
4378993429,3cyclictest41-21ksoftirqd/307:30:533
4378993429,3cyclictest41-21ksoftirqd/307:30:523
4378993428,4cyclictest41-21ksoftirqd/312:34:493
4378993428,4cyclictest41-21ksoftirqd/309:38:453
4378993428,4cyclictest41-21ksoftirqd/308:20:593
4378993428,4cyclictest41-21ksoftirqd/307:49:143
4377993429,3cyclictest33-21ksoftirqd/207:50:112
4377993428,4cyclictest33-21ksoftirqd/208:09:392
4377993417,7cyclictest33-21ksoftirqd/207:15:232
4376993429,3cyclictest25-21ksoftirqd/112:00:121
4376993429,3cyclictest25-21ksoftirqd/108:30:131
4376993428,4cyclictest25-21ksoftirqd/109:30:091
4376993428,4cyclictest25-21ksoftirqd/109:17:581
4376993428,4cyclictest25-21ksoftirqd/108:51:581
4376993428,4cyclictest25-21ksoftirqd/108:49:181
4376993428,4cyclictest25-21ksoftirqd/107:39:101
437599344,13cyclictest23386-21memory11:10:220
4378993328,3cyclictest41-21ksoftirqd/307:36:483
4378993327,4cyclictest41-21ksoftirqd/312:15:393
4378993327,4cyclictest41-21ksoftirqd/311:54:413
4378993327,4cyclictest41-21ksoftirqd/311:35:353
4378993327,4cyclictest41-21ksoftirqd/311:13:013
4378993327,4cyclictest41-21ksoftirqd/310:28:043
4378993327,4cyclictest41-21ksoftirqd/309:43:073
4378993327,4cyclictest41-21ksoftirqd/308:37:253
4378993327,4cyclictest41-21ksoftirqd/308:03:433
4377993328,3cyclictest33-21ksoftirqd/211:00:112
4377993327,4cyclictest33-21ksoftirqd/212:09:242
4377993327,4cyclictest33-21ksoftirqd/211:55:122
4377993327,4cyclictest33-21ksoftirqd/210:42:192
4377993327,4cyclictest33-21ksoftirqd/210:07:142
4377993327,4cyclictest33-21ksoftirqd/208:19:012
4377993327,4cyclictest33-21ksoftirqd/208:03:452
4377993327,4cyclictest33-21ksoftirqd/207:29:202
4377993326,5cyclictest33-21ksoftirqd/212:15:422
437799332,5cyclictest33-21ksoftirqd/211:13:442
4377993319,3cyclictest33-21ksoftirqd/211:45:072
4376993328,3cyclictest25-21ksoftirqd/108:59:111
4376993327,4cyclictest25-21ksoftirqd/111:22:461
4376993327,4cyclictest25-21ksoftirqd/109:50:561
4376993327,4cyclictest25-21ksoftirqd/108:28:071
4376993327,4cyclictest25-21ksoftirqd/107:55:541
4376993327,4cyclictest25-21ksoftirqd/107:23:011
4376993326,5cyclictest25-21ksoftirqd/111:06:091
4376993311,19cyclictest29979-21cat08:00:281
437599338,15cyclictest21370-21/usr/sbin/munin11:05:260
437599338,10cyclictest4678-21/usr/sbin/munin08:15:250
437599334,13cyclictest21525-21df07:45:150
4375993327,4cyclictest9-21ksoftirqd/010:22:310
4375993327,4cyclictest9-21ksoftirqd/010:22:310
4375993326,5cyclictest9-21ksoftirqd/010:59:060
4378993227,3cyclictest41-21ksoftirqd/311:25:003
4378993227,3cyclictest41-21ksoftirqd/309:30:243
4378993227,3cyclictest21936-21perf08:54:593
4378993226,4cyclictest41-21ksoftirqd/311:58:503
4377993227,3cyclictest33-21ksoftirqd/211:54:552
4377993226,4cyclictest33-21ksoftirqd/212:33:352
4377993226,4cyclictest33-21ksoftirqd/212:27:252
4377993226,4cyclictest33-21ksoftirqd/210:52:412
4377993226,4cyclictest33-21ksoftirqd/207:47:522
4377993225,5cyclictest33-21ksoftirqd/208:37:232
4377993225,4cyclictest33-21ksoftirqd/212:21:432
4377993225,4cyclictest33-21ksoftirqd/209:42:222
4377993216,9cyclictest33-21ksoftirqd/211:32:422
4376993226,4cyclictest25-21ksoftirqd/111:44:481
4376993226,4cyclictest25-21ksoftirqd/111:37:581
4376993226,4cyclictest25-21ksoftirqd/109:35:261
4376993226,4cyclictest25-21ksoftirqd/109:02:211
437699322,4cyclictest0-21swapper/107:25:131
4376993212,17cyclictest20073-21needreboot12:10:241
437599323,16cyclictest0-21swapper/007:40:180
437599322,16cyclictest0-21swapper/012:20:230
4378993127,3cyclictest41-21ksoftirqd/312:10:143
4378993126,3cyclictest41-21ksoftirqd/312:20:083
4378993126,3cyclictest41-21ksoftirqd/310:12:153
4378993126,3cyclictest41-21ksoftirqd/308:59:183
4378993125,4cyclictest41-21ksoftirqd/309:08:133
4378993124,4cyclictest41-21ksoftirqd/308:25:163
437799318,21cyclictest9846-21kworker/2:109:55:292
4377993126,3cyclictest33-21ksoftirqd/207:32:162
4377993126,3cyclictest33-21ksoftirqd/207:32:162
4377993125,4cyclictest33-21ksoftirqd/210:56:392
4377993125,4cyclictest33-21ksoftirqd/209:22:442
4377993125,4cyclictest33-21ksoftirqd/208:20:592
437699319,3cyclictest24674-21expr10:05:221
437699319,3cyclictest22783-21fschecks_count11:10:171
4376993126,3cyclictest25-21ksoftirqd/110:57:161
4376993126,3cyclictest25-21ksoftirqd/110:35:001
4376993126,3cyclictest25-21ksoftirqd/110:18:171
4376993126,3cyclictest25-21ksoftirqd/107:41:251
4376993125,4cyclictest25-21ksoftirqd/107:50:321
4376993125,4cyclictest25-21ksoftirqd/107:32:311
4376993125,4cyclictest25-21ksoftirqd/107:32:311
4376993124,4cyclictest25-21ksoftirqd/110:39:091
437599313,18cyclictest0-21swapper/009:15:200
437599313,18cyclictest0-21swapper/007:20:210
4375993125,4cyclictest9-21ksoftirqd/012:12:150
4375993125,4cyclictest9-21ksoftirqd/010:01:490
4375993125,4cyclictest9-21ksoftirqd/009:29:280
437599312,18cyclictest0-21swapper/010:25:130
437599312,17cyclictest0-21swapper/008:55:130
4378993025,3cyclictest41-21ksoftirqd/312:06:113
4378993025,3cyclictest41-21ksoftirqd/309:16:363
4378993024,4cyclictest41-21ksoftirqd/310:01:043
437799302,5cyclictest33-21ksoftirqd/211:05:192
4377993025,3cyclictest33-21ksoftirqd/210:15:552
4377993024,4cyclictest33-21ksoftirqd/212:03:022
4377993023,5cyclictest33-21ksoftirqd/210:35:012
4377993013,9cyclictest33-21ksoftirqd/210:00:212
437799301,12cyclictest18765-21gunzip08:45:252
437699308,3cyclictest29455-21sshd11:25:061
437699306,4cyclictest0-21swapper/112:25:151
437699302,5cyclictest2031-21Xorg07:12:591
4376993025,3cyclictest25-21ksoftirqd/107:47:071
4376993025,3cyclictest25-21ksoftirqd/107:19:291
437699302,4cyclictest0-21swapper/109:45:131
4376993024,4cyclictest25-21ksoftirqd/111:52:381
4376993024,4cyclictest25-21ksoftirqd/110:26:161
4376993011,16cyclictest19844-21load09:55:221
4375993025,3cyclictest9-21ksoftirqd/008:39:130
139391300,0ptp4l401ktimersoftd/310:46:583
4378992924,3cyclictest41-21ksoftirqd/312:38:023
4378992924,3cyclictest41-21ksoftirqd/307:55:073
4378992923,4cyclictest41-21ksoftirqd/311:31:423
4378992923,4cyclictest41-21ksoftirqd/309:58:353
437799294,3cyclictest33-21ksoftirqd/209:05:152
4377992924,3cyclictest33-21ksoftirqd/209:45:212
4377992924,3cyclictest33-21ksoftirqd/208:30:212
4377992915,3cyclictest33-21ksoftirqd/209:52:202
4377992914,8cyclictest33-21ksoftirqd/209:36:192
437699298,3cyclictest241ktimersoftd/108:15:241
437699294,4cyclictest23370-21cat10:05:001
4376992924,3cyclictest25-21ksoftirqd/111:57:111
437599293,15cyclictest0-21swapper/011:55:200
437599292,18cyclictest0-21swapper/010:40:110
437599292,17cyclictest0-21swapper/011:15:190
437599292,15cyclictest0-21swapper/007:25:180
139391290,0ptp4l401ktimersoftd/311:26:083
139391290,0ptp4l401ktimersoftd/309:54:323
139391290,0ptp4l401ktimersoftd/308:14:143
4378992823,3cyclictest41-21ksoftirqd/311:47:183
4378992823,3cyclictest41-21ksoftirqd/311:15:203
4378992823,3cyclictest41-21ksoftirqd/310:19:073
4378992823,3cyclictest41-21ksoftirqd/310:09:353
4378992822,4cyclictest41-21ksoftirqd/308:18:543
4377992823,3cyclictest33-21ksoftirqd/211:27:402
4377992823,3cyclictest33-21ksoftirqd/209:10:042
4376992823,3cyclictest25-21ksoftirqd/111:50:001
4376992823,3cyclictest25-21ksoftirqd/111:15:281
4376992821,5cyclictest25-21ksoftirqd/110:48:281
437599285,7cyclictest11507-21apt-get09:40:120
4375992822,4cyclictest9-21ksoftirqd/012:30:120
437599282,17cyclictest0-21swapper/010:50:210
4378992722,3cyclictest41-21ksoftirqd/310:31:093
4378992721,4cyclictest41-21ksoftirqd/308:42:583
4377992721,3cyclictest33-21ksoftirqd/207:20:242
437699276,3cyclictest6406-21irqrtprio08:20:201
437599272,15cyclictest0-21swapper/011:35:260
139391270,0ptp4l401ktimersoftd/310:44:283
139391270,0ptp4l401ktimersoftd/308:46:273
139391270,0ptp4l401ktimersoftd/307:24:343
437799263,8cyclictest33-21ksoftirqd/212:10:292
437799263,8cyclictest33-21ksoftirqd/210:20:092
437799263,8cyclictest33-21ksoftirqd/210:20:092
437799263,4cyclictest33-21ksoftirqd/208:11:272
4377992623,2cyclictest33-21ksoftirqd/211:40:272
4377992620,4cyclictest33-21ksoftirqd/207:35:132
437799260,10cyclictest33-21ksoftirqd/208:54:242
4378992520,3cyclictest41-21ksoftirqd/310:58:503
4378992520,3cyclictest41-21ksoftirqd/308:34:563
4378992520,3cyclictest41-21ksoftirqd/307:17:023
4378992419,3cyclictest41-21ksoftirqd/309:27:353
4377992419,3cyclictest33-21ksoftirqd/208:55:312
437599244,7cyclictest25948-21apt-get10:10:120
139391230,0ptp4l401ktimersoftd/310:35:323
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional