You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-03 - 19:41
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot4.osadl.org (updated Thu Jul 03, 2025 12:45:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
60512207172,23sleep00-21swapper/007:09:210
59232202169,22sleep10-21swapper/107:07:411
58362202169,22sleep30-21swapper/307:06:353
58302202169,22sleep20-21swapper/207:06:302
2432021440,7sleep3647399cyclictest08:50:123
2296621240,2sleep00-21swapper/008:45:210
134991720,12ptp4l0-21swapper/308:15:013
134991660,1ptp4l401ktimersoftd/310:06:223
647299615,10cyclictest4862-21df_abs09:15:142
647299588,12cyclictest14473-21tr09:35:142
647299553,11cyclictest32174-21/usr/sbin/munin09:05:142
146282550,3sleep314621-21apt11:45:013
146282550,3sleep314621-21apt11:45:003
222772520,2sleep00-21swapper/007:40:160
647299501,9cyclictest0-21swapper/211:30:162
134991500,1ptp4l401ktimersoftd/311:31:533
647299483,13cyclictest12006-21diskstats08:25:162
647299472,13cyclictest16828-21apt-get09:40:132
647299462,9cyclictest23932-21taskset09:54:122
647299443,15cyclictest1264-21snmpd10:22:422
647299433,8cyclictest3842-21ssh12:25:252
647299433,8cyclictest3842-21ssh12:25:252
647299423,7cyclictest2905-21df11:20:152
647199421,38cyclictest19530-21dump-pmu-power11:55:001
134991420,0ptp4l401ktimersoftd/308:08:223
134991410,0ptp4l401ktimersoftd/311:58:043
134991410,0ptp4l401ktimersoftd/311:00:273
134991410,0ptp4l401ktimersoftd/307:27:123
6472994027,11cyclictest33-21ksoftirqd/211:50:212
6471994034,3cyclictest16557-21cron09:40:011
6471994033,4cyclictest25-21ksoftirqd/109:04:591
6471994033,4cyclictest25-21ksoftirqd/109:04:591
134991400,0ptp4l401ktimersoftd/309:50:003
647199390,37cyclictest181-21jbd2/mmcblk1p1-10:45:011
6470993934,3cyclictest4454-21cron12:30:000
6470993934,3cyclictest4454-21cron12:30:000
6472993833,3cyclictest359-21rs:main2
6472993831,5cyclictest33-21ksoftirqd/209:20:522
6471993833,3cyclictest25-21ksoftirqd/109:50:001
6473993731,4cyclictest41-21ksoftirqd/310:16:053
6473993731,4cyclictest41-21ksoftirqd/309:23:273
6473993731,4cyclictest41-21ksoftirqd/309:12:083
6471993731,4cyclictest25-21ksoftirqd/108:18:591
6473993630,4cyclictest41-21ksoftirqd/310:45:113
6473993629,4cyclictest41-21ksoftirqd/311:35:143
647399361,33cyclictest16502-21cron10:45:013
6471993631,3cyclictest25-21ksoftirqd/111:09:401
6471993631,3cyclictest25-21ksoftirqd/108:28:411
6471993630,4cyclictest25-21ksoftirqd/111:41:461
6471993630,4cyclictest25-21ksoftirqd/111:41:461
6471993630,4cyclictest25-21ksoftirqd/111:01:091
6471993630,4cyclictest25-21ksoftirqd/109:25:581
6471993629,4cyclictest25-21ksoftirqd/110:03:501
6470993633,2cyclictest9-21ksoftirqd/008:20:000
6470993631,3cyclictest9-21ksoftirqd/007:40:010
6470993630,4cyclictest9-21ksoftirqd/010:51:570
6473993529,4cyclictest41-21ksoftirqd/309:00:473
6473993529,4cyclictest41-21ksoftirqd/309:00:473
6473993529,4cyclictest41-21ksoftirqd/308:25:423
6471993529,4cyclictest25-21ksoftirqd/112:14:221
6471993529,4cyclictest25-21ksoftirqd/111:38:531
6471993529,4cyclictest25-21ksoftirqd/111:19:301
6471993529,4cyclictest25-21ksoftirqd/110:29:401
6471993529,4cyclictest25-21ksoftirqd/108:58:581
6471993529,4cyclictest25-21ksoftirqd/107:24:061
6470993529,4cyclictest9-21ksoftirqd/010:25:000
6470993529,4cyclictest9-21ksoftirqd/007:24:370
134991350,8ptp4l401ktimersoftd/308:00:593
134991350,8ptp4l401ktimersoftd/308:00:593
6473993430,3cyclictest41-21ksoftirqd/310:22:133
6473993428,4cyclictest41-21ksoftirqd/312:32:193
6473993428,4cyclictest41-21ksoftirqd/310:15:003
6473993428,4cyclictest41-21ksoftirqd/308:33:163
6473993427,5cyclictest41-21ksoftirqd/308:18:043
647299348,11cyclictest3436-21mailstats10:15:262
6472993429,3cyclictest33-21ksoftirqd/210:28:002
6472993429,3cyclictest33-21ksoftirqd/207:25:112
6472993428,4cyclictest33-21ksoftirqd/211:11:142
6472993428,4cyclictest33-21ksoftirqd/210:05:462
6472993428,4cyclictest33-21ksoftirqd/208:38:202
6472993428,4cyclictest33-21ksoftirqd/207:21:112
6471993428,4cyclictest25-21ksoftirqd/111:47:381
6471993428,4cyclictest25-21ksoftirqd/111:28:331
6471993428,4cyclictest25-21ksoftirqd/109:58:021
6471993428,4cyclictest25-21ksoftirqd/109:18:561
6471993428,4cyclictest25-21ksoftirqd/109:12:581
6471993428,4cyclictest25-21ksoftirqd/108:06:181
6471993428,4cyclictest25-21ksoftirqd/107:56:271
6471993428,4cyclictest25-21ksoftirqd/107:39:101
6471993428,3cyclictest25-21ksoftirqd/109:06:101
6471993427,4cyclictest25-21ksoftirqd/107:30:321
6471993426,5cyclictest25-21ksoftirqd/110:59:591
6470993429,3cyclictest9-21ksoftirqd/010:40:000
6470993429,3cyclictest9-21ksoftirqd/010:28:530
6470993428,4cyclictest9-21ksoftirqd/011:04:580
6470993428,4cyclictest9-21ksoftirqd/009:42:130
6470993428,4cyclictest9-21ksoftirqd/008:25:390
6470993428,4cyclictest9-21ksoftirqd/008:21:130
6473993327,4cyclictest41-21ksoftirqd/312:18:023
6473993327,4cyclictest41-21ksoftirqd/312:12:523
6473993327,4cyclictest41-21ksoftirqd/310:01:533
6473993327,4cyclictest41-21ksoftirqd/309:40:363
647399330,2cyclictest121rcu_preempt11:10:243
647299335,5cyclictest0-21swapper/209:30:272
647299335,5cyclictest0-21swapper/209:30:272
647299333,3cyclictest121rcu_preempt07:12:042
6472993328,3cyclictest33-21ksoftirqd/208:59:432
6472993327,4cyclictest33-21ksoftirqd/210:58:022
6472993327,4cyclictest33-21ksoftirqd/207:30:532
6471993328,3cyclictest25-21ksoftirqd/112:38:301
6471993328,3cyclictest25-21ksoftirqd/112:29:521
6471993328,3cyclictest25-21ksoftirqd/112:29:521
6471993328,3cyclictest25-21ksoftirqd/112:04:431
6471993328,3cyclictest25-21ksoftirqd/110:17:481
6471993328,3cyclictest25-21ksoftirqd/108:45:011
6471993328,3cyclictest25-21ksoftirqd/107:47:041
6471993327,4cyclictest25-21ksoftirqd/111:56:531
6471993327,4cyclictest25-21ksoftirqd/111:21:151
6471993327,4cyclictest25-21ksoftirqd/111:11:041
6471993327,4cyclictest25-21ksoftirqd/110:52:191
6471993327,4cyclictest25-21ksoftirqd/109:50:121
6471993327,4cyclictest25-21ksoftirqd/109:43:231
6471993327,4cyclictest25-21ksoftirqd/109:21:201
6471993327,4cyclictest25-21ksoftirqd/108:30:291
6470993328,3cyclictest9-21ksoftirqd/011:13:100
6470993328,3cyclictest9-21ksoftirqd/010:10:010
6470993328,3cyclictest9-21ksoftirqd/008:33:560
6470993327,4cyclictest9-21ksoftirqd/012:04:070
6470993327,4cyclictest9-21ksoftirqd/011:32:490
6470993327,4cyclictest9-21ksoftirqd/007:31:150
6470993327,3cyclictest9-21ksoftirqd/011:47:300
134991330,0ptp4l401ktimersoftd/310:53:353
6473993228,2cyclictest41-21ksoftirqd/311:19:593
6473993227,3cyclictest41-21ksoftirqd/312:02:493
6473993227,3cyclictest41-21ksoftirqd/311:26:483
6473993227,3cyclictest41-21ksoftirqd/311:06:013
6473993227,3cyclictest41-21ksoftirqd/309:19:183
6473993227,3cyclictest41-21ksoftirqd/307:39:163
6473993226,4cyclictest41-21ksoftirqd/309:55:513
6473993226,4cyclictest41-21ksoftirqd/308:46:443
6473993226,4cyclictest41-21ksoftirqd/308:43:513
6473993226,4cyclictest41-21ksoftirqd/308:20:443
647299322,8cyclictest7623-21diskstats12:35:142
6472993227,3cyclictest33-21ksoftirqd/210:38:312
6472993227,3cyclictest33-21ksoftirqd/209:59:122
6472993226,4cyclictest33-21ksoftirqd/210:45:412
6472993226,4cyclictest33-21ksoftirqd/208:54:372
6472993226,4cyclictest33-21ksoftirqd/208:09:042
6471993227,3cyclictest25-21ksoftirqd/111:34:071
6471993227,3cyclictest25-21ksoftirqd/108:02:281
6471993227,3cyclictest25-21ksoftirqd/108:02:271
6471993226,4cyclictest25-21ksoftirqd/112:18:411
6471993226,4cyclictest25-21ksoftirqd/112:08:201
6471993226,4cyclictest25-21ksoftirqd/110:38:111
6471993226,4cyclictest25-21ksoftirqd/108:39:401
6471993226,4cyclictest25-21ksoftirqd/107:53:501
6471993226,4cyclictest25-21ksoftirqd/107:40:391
6471993226,3cyclictest25-21ksoftirqd/112:20:131
6471993225,4cyclictest25-21ksoftirqd/110:45:051
6470993227,3cyclictest9-21ksoftirqd/012:18:130
6470993227,3cyclictest9-21ksoftirqd/012:06:200
6470993227,3cyclictest9-21ksoftirqd/011:25:440
6470993227,3cyclictest9-21ksoftirqd/009:21:500
6470993226,4cyclictest9-21ksoftirqd/012:37:360
6470993226,4cyclictest9-21ksoftirqd/009:53:050
6470993226,4cyclictest9-21ksoftirqd/009:08:270
6470993226,4cyclictest9-21ksoftirqd/008:13:070
6470993226,3cyclictest9-21ksoftirqd/011:09:410
134991320,0ptp4l401ktimersoftd/308:55:293
134991320,0ptp4l401ktimersoftd/307:15:153
6473993126,3cyclictest41-21ksoftirqd/307:48:403
6473993125,4cyclictest41-21ksoftirqd/312:25:373
6473993125,4cyclictest41-21ksoftirqd/312:25:373
6473993125,4cyclictest41-21ksoftirqd/310:36:443
647399311,2cyclictest121rcu_preempt09:38:463
647399310,2cyclictest121rcu_preempt10:34:513
6472993126,3cyclictest33-21ksoftirqd/212:02:122
6472993126,3cyclictest33-21ksoftirqd/210:51:282
6472993125,4cyclictest33-21ksoftirqd/211:59:212
6472993125,4cyclictest33-21ksoftirqd/211:00:022
6472993125,4cyclictest33-21ksoftirqd/208:41:292
6472993125,4cyclictest33-21ksoftirqd/208:03:462
6472993125,4cyclictest33-21ksoftirqd/208:03:462
6472993125,4cyclictest33-21ksoftirqd/207:37:422
6472993125,4cyclictest33-21ksoftirqd/207:19:172
6472993124,5cyclictest33-21ksoftirqd/208:15:332
6471993126,3cyclictest25-21ksoftirqd/110:23:171
6471993125,4cyclictest25-21ksoftirqd/110:34:381
6471993125,3cyclictest25-21ksoftirqd/108:47:571
6470993126,3cyclictest9-21ksoftirqd/011:35:060
6470993126,3cyclictest9-21ksoftirqd/007:50:280
6470993125,4cyclictest9-21ksoftirqd/012:24:160
6470993125,4cyclictest9-21ksoftirqd/009:20:000
6470993125,4cyclictest9-21ksoftirqd/009:14:450
6470993125,3cyclictest9-21ksoftirqd/008:39:460
134991310,0ptp4l401ktimersoftd/312:20:183
6473993025,3cyclictest41-21ksoftirqd/310:26:473
6473993024,4cyclictest41-21ksoftirqd/307:34:313
6473993024,4cyclictest41-21ksoftirqd/307:10:523
6472993025,3cyclictest33-21ksoftirqd/212:33:452
6472993025,3cyclictest33-21ksoftirqd/212:06:022
6472993025,3cyclictest33-21ksoftirqd/207:44:302
647299302,16cyclictest3402-21ls09:10:282
6470993025,3cyclictest9-21ksoftirqd/012:32:020
6470993025,3cyclictest9-21ksoftirqd/011:15:250
6470993025,3cyclictest9-21ksoftirqd/010:59:040
6470993025,3cyclictest9-21ksoftirqd/010:33:480
6470993025,3cyclictest9-21ksoftirqd/010:18:510
6470993025,3cyclictest9-21ksoftirqd/008:45:000
6470993025,3cyclictest9-21ksoftirqd/007:25:190
6470993024,4cyclictest9-21ksoftirqd/011:50:350
6470993024,4cyclictest9-21ksoftirqd/007:17:590
134991300,0ptp4l401ktimersoftd/311:20:273
134991300,0ptp4l401ktimersoftd/309:31:013
134991300,0ptp4l401ktimersoftd/309:31:013
134991300,0ptp4l401ktimersoftd/307:40:243
6473992924,3cyclictest41-21ksoftirqd/307:54:263
6473992923,4cyclictest41-21ksoftirqd/307:22:393
6472992924,3cyclictest33-21ksoftirqd/211:42:162
6472992924,3cyclictest33-21ksoftirqd/211:42:162
6472992924,3cyclictest33-21ksoftirqd/211:08:332
6472992924,3cyclictest33-21ksoftirqd/208:47:592
6472992924,3cyclictest28797-21cron07:55:002
6472992923,4cyclictest33-21ksoftirqd/212:11:382
6472992923,4cyclictest33-21ksoftirqd/211:29:302
6472992923,4cyclictest33-21ksoftirqd/210:13:372
6472992923,4cyclictest33-21ksoftirqd/208:30:532
6471992923,4cyclictest25-21ksoftirqd/108:53:281
6470992924,3cyclictest9-21ksoftirqd/007:58:100
6470992924,3cyclictest9-21ksoftirqd/007:45:330
6470992923,4cyclictest9-21ksoftirqd/009:31:370
6470992923,4cyclictest9-21ksoftirqd/009:31:370
134991290,0ptp4l401ktimersoftd/307:58:373
6473992823,3cyclictest41-21ksoftirqd/309:46:503
6472992823,3cyclictest33-21ksoftirqd/211:17:172
6472992822,4cyclictest33-21ksoftirqd/210:44:372
6472992822,4cyclictest33-21ksoftirqd/209:46:042
647299281,3cyclictest15822-21sed11:45:202
6471992823,3cyclictest25-21ksoftirqd/107:16:341
6471992822,4cyclictest25-21ksoftirqd/110:14:351
6471992822,3cyclictest25-21ksoftirqd/108:13:231
6470992823,3cyclictest9-21ksoftirqd/010:43:140
6470992823,3cyclictest9-21ksoftirqd/010:10:060
6470992822,4cyclictest9-21ksoftirqd/012:13:340
6470992822,4cyclictest9-21ksoftirqd/011:58:420
134991280,0ptp4l401ktimersoftd/312:37:483
134991280,0ptp4l401ktimersoftd/311:51:053
6473992722,3cyclictest41-21ksoftirqd/311:45:533
6473992722,3cyclictest41-21ksoftirqd/308:37:583
647299277,18cyclictest0-21swapper/207:45:202
6472992722,3cyclictest33-21ksoftirqd/209:01:232
6472992722,3cyclictest33-21ksoftirqd/209:01:232
6471992721,4cyclictest25-21ksoftirqd/107:14:471
6470992722,3cyclictest9-21ksoftirqd/009:55:280
6470992722,3cyclictest9-21ksoftirqd/009:46:390
6470992722,3cyclictest9-21ksoftirqd/008:01:160
6470992722,3cyclictest9-21ksoftirqd/008:01:160
6470992721,4cyclictest9-21ksoftirqd/008:58:570
6470992720,5cyclictest9-21ksoftirqd/010:46:510
6473992621,3cyclictest41-21ksoftirqd/312:09:033
6473992621,3cyclictest41-21ksoftirqd/310:58:463
647299265,18cyclictest9560-21seq10:30:152
6472992620,4cyclictest33-21ksoftirqd/212:17:162
647299261,23cyclictest0-21swapper/212:20:272
6471992620,4cyclictest25-21ksoftirqd/112:34:091
6470992621,3cyclictest9-21ksoftirqd/008:10:010
6470992620,4cyclictest9-21ksoftirqd/011:21:310
6470992620,4cyclictest9-21ksoftirqd/009:36:050
134991260,0ptp4l401ktimersoftd/309:26:333
6473992520,3cyclictest41-21ksoftirqd/309:10:003
6472992519,4cyclictest33-21ksoftirqd/208:14:342
6471992520,3cyclictest25-21ksoftirqd/109:31:471
6471992520,3cyclictest25-21ksoftirqd/109:31:471
6471992519,4cyclictest9819-21/usr/sbin/munin08:20:201
6470992520,3cyclictest9-21ksoftirqd/010:05:010
6470992518,4cyclictest9-21ksoftirqd/009:25:100
6472992419,3cyclictest33-21ksoftirqd/210:03:022
647299241,14cyclictest9416-21/usr/sbin/munin09:25:142
6470992418,3cyclictest9-21ksoftirqd/009:05:000
6470992418,3cyclictest9-21ksoftirqd/009:05:000
6472992318,3cyclictest33-21ksoftirqd/208:24:282
6470992318,3cyclictest9-21ksoftirqd/008:50:150
6470992318,3cyclictest9-21ksoftirqd/007:12:490
6470992316,4cyclictest9-21ksoftirqd/011:40:120
6470992316,4cyclictest9-21ksoftirqd/011:40:120
6472991914,3cyclictest33-21ksoftirqd/211:35:462
6471991712,3cyclictest29834-21df_abs10:05:161
6471991712,3cyclictest15843-21date07:25:261
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional