You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-19 - 20:14
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot4.osadl.org (updated Wed Nov 19, 2025 12:45:59)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
11062204169,23sleep30-21swapper/307:07:473
11062204169,23sleep30-21swapper/307:07:463
9442203170,22sleep20-21swapper/207:05:522
9442203170,22sleep20-21swapper/207:05:522
10602203169,23sleep00-21swapper/007:07:110
10602203169,23sleep00-21swapper/007:07:110
314162201167,22sleep10-21swapper/107:05:031
314162201167,22sleep10-21swapper/107:05:031
4272911350,1ptp4l1226-21dump-pmu-power12:30:013
129928161,11sleep00-21swapper/007:10:000
427291610,1ptp4l401ktimersoftd/312:03:323
427291600,1ptp4l401ktimersoftd/311:25:413
307042600,3sleep10-21swapper/110:15:151
427291590,1ptp4l401ktimersoftd/308:28:003
427291580,1ptp4l401ktimersoftd/311:35:183
427291580,0ptp4l401ktimersoftd/312:07:393
189832580,7sleep2164999cyclictest12:00:152
427291540,1ptp4l401ktimersoftd/308:58:583
201332530,2sleep10-21swapper/112:00:261
1650995333,18cyclictest41-21ksoftirqd/310:13:193
156832530,2sleep30-21swapper/308:40:213
427291500,1ptp4l401ktimersoftd/312:39:363
229102500,5sleep022915-21hwlatdetect08:55:180
1649994930,16cyclictest33-21ksoftirqd/209:50:012
1648994437,4cyclictest11569-21cron07:30:001
427291430,34ptp4l0-21swapper/307:10:013
1649994338,3cyclictest33-21ksoftirqd/207:15:002
1648994338,3cyclictest25-21ksoftirqd/109:40:001
1648994338,3cyclictest25-21ksoftirqd/109:40:001
164799430,40cyclictest9571-21cron09:35:000
1648994236,4cyclictest25-21ksoftirqd/111:39:591
427291410,0ptp4l401ktimersoftd/311:10:213
1649994137,2cyclictest31115-21cron12:25:002
1649994134,5cyclictest33-21ksoftirqd/209:30:002
164999411,38cyclictest28090-21kworker/2:109:06:262
164999411,38cyclictest28090-21kworker/2:109:06:262
1648994136,3cyclictest25-21ksoftirqd/108:50:001
1650994034,4cyclictest41-21ksoftirqd/311:52:463
1649994035,2cyclictest19588-21sh08:50:002
1648994032,5cyclictest27540-21cron10:10:001
1648994032,5cyclictest27540-21cron10:10:001
427291390,0ptp4l401ktimersoftd/311:00:233
36998390,6rtkit-daemon0-21swapper/111:56:221
1650993933,4cyclictest41-21ksoftirqd/310:26:363
1650993933,4cyclictest41-21ksoftirqd/308:06:153
1650993933,4cyclictest41-21ksoftirqd/308:06:153
1650993933,4cyclictest41-21ksoftirqd/307:21:143
1650993931,5cyclictest41-21ksoftirqd/312:23:443
1648993934,3cyclictest25-21ksoftirqd/109:55:001
1648993934,3cyclictest25-21ksoftirqd/107:15:011
1648993933,4cyclictest25-21ksoftirqd/112:13:011
1648993933,4cyclictest25-21ksoftirqd/108:23:421
1648993933,3cyclictest25-21ksoftirqd/108:45:001
1647993932,5cyclictest9-21ksoftirqd/009:46:300
1650993833,3cyclictest41-21ksoftirqd/309:01:593
1650993833,3cyclictest41-21ksoftirqd/308:04:433
1650993832,4cyclictest41-21ksoftirqd/310:39:483
1650993832,4cyclictest41-21ksoftirqd/310:18:063
1650993832,4cyclictest41-21ksoftirqd/309:50:013
1650993832,4cyclictest41-21ksoftirqd/308:37:293
1650993832,4cyclictest41-21ksoftirqd/308:37:283
1649993833,3cyclictest33-21ksoftirqd/211:33:192
1649993833,3cyclictest33-21ksoftirqd/211:13:362
1649993832,4cyclictest33-21ksoftirqd/211:24:042
1649993831,4cyclictest33-21ksoftirqd/211:38:122
1648993833,3cyclictest25-21ksoftirqd/108:40:001
1648993833,3cyclictest25-21ksoftirqd/108:40:001
1648993832,4cyclictest25-21ksoftirqd/111:16:241
1648993832,4cyclictest25-21ksoftirqd/110:27:351
1648993832,4cyclictest25-21ksoftirqd/110:21:011
1648993832,4cyclictest25-21ksoftirqd/107:59:231
1648993832,3cyclictest25-21ksoftirqd/112:19:591
1648993832,3cyclictest25-21ksoftirqd/109:47:031
1648993831,4cyclictest25-21ksoftirqd/112:07:321
1648993831,4cyclictest25-21ksoftirqd/109:56:341
1648993831,4cyclictest25-21ksoftirqd/107:15:461
1647993832,4cyclictest9-21ksoftirqd/007:49:310
1647993831,4cyclictest9-21ksoftirqd/009:19:140
1647993831,4cyclictest359-21rs:main0
1647993814,21cyclictest31737-21sed08:10:010
1647993814,21cyclictest31737-21sed08:10:000
36998370,6rtkit-daemon0-21swapper/110:39:241
2357823730,3sleep125-21ksoftirqd/110:00:201
1650993731,4cyclictest41-21ksoftirqd/309:20:413
1650993731,4cyclictest41-21ksoftirqd/309:19:213
1650993731,4cyclictest41-21ksoftirqd/309:14:353
1650993731,4cyclictest41-21ksoftirqd/309:09:313
1650993731,4cyclictest41-21ksoftirqd/309:09:303
1650993731,4cyclictest41-21ksoftirqd/308:21:113
1650993730,5cyclictest41-21ksoftirqd/309:50:143
1649993731,4cyclictest33-21ksoftirqd/212:35:002
1649993731,4cyclictest33-21ksoftirqd/212:17:122
1649993731,4cyclictest33-21ksoftirqd/209:36:082
1649993731,4cyclictest33-21ksoftirqd/209:36:082
1649993731,4cyclictest33-21ksoftirqd/209:17:272
1649993730,4cyclictest33-21ksoftirqd/211:41:542
1648993731,4cyclictest25-21ksoftirqd/109:30:461
1648993731,4cyclictest25-21ksoftirqd/108:00:391
1648993731,3cyclictest8058-21cron10:35:001
1648993730,4cyclictest25-21ksoftirqd/109:10:001
1648993730,4cyclictest25-21ksoftirqd/109:10:001
1647993731,4cyclictest9-21ksoftirqd/011:10:340
1647993731,4cyclictest9-21ksoftirqd/007:52:440
1647993731,4cyclictest9-21ksoftirqd/007:23:230
1647993730,4cyclictest9-21ksoftirqd/010:31:190
1647993730,4cyclictest9-21ksoftirqd/007:37:160
1650993631,3cyclictest41-21ksoftirqd/311:56:123
1650993631,3cyclictest41-21ksoftirqd/311:18:033
1650993631,3cyclictest41-21ksoftirqd/307:31:013
1650993630,4cyclictest41-21ksoftirqd/310:49:473
1650993630,4cyclictest41-21ksoftirqd/309:59:203
1650993630,4cyclictest41-21ksoftirqd/308:49:363
1650993630,4cyclictest41-21ksoftirqd/307:37:593
1650993629,4cyclictest41-21ksoftirqd/310:08:353
1650993629,4cyclictest41-21ksoftirqd/310:08:353
1650993628,5cyclictest41-21ksoftirqd/308:13:433
1649993631,3cyclictest33-21ksoftirqd/212:39:462
1649993630,4cyclictest33-21ksoftirqd/210:35:462
1649993630,4cyclictest33-21ksoftirqd/210:14:242
1649993630,4cyclictest33-21ksoftirqd/207:50:412
1649993630,4cyclictest33-21ksoftirqd/207:32:482
1649993629,4cyclictest33-21ksoftirqd/210:00:562
1648993631,3cyclictest25-21ksoftirqd/112:25:491
1648993631,3cyclictest25-21ksoftirqd/107:44:551
1648993630,4cyclictest25-21ksoftirqd/107:30:391
1648993629,4cyclictest25-21ksoftirqd/112:36:291
1648993629,4cyclictest25-21ksoftirqd/111:03:571
1647993630,4cyclictest9-21ksoftirqd/011:46:090
1647993630,4cyclictest9-21ksoftirqd/009:04:090
1647993630,3cyclictest9-21ksoftirqd/011:53:260
1647993612,21cyclictest9229-21cut11:40:170
36998350,2rtkit-daemon0-21swapper/111:28:241
1650993530,3cyclictest41-21ksoftirqd/311:20:523
1650993530,3cyclictest41-21ksoftirqd/307:53:163
1650993529,4cyclictest41-21ksoftirqd/309:33:373
1650993529,4cyclictest41-21ksoftirqd/307:59:253
1649993530,3cyclictest33-21ksoftirqd/207:41:152
1649993529,4cyclictest33-21ksoftirqd/212:05:042
1649993529,4cyclictest33-21ksoftirqd/209:50:402
1649993529,4cyclictest33-21ksoftirqd/208:43:012
1649993529,3cyclictest33-21ksoftirqd/208:10:112
1648993530,3cyclictest25-21ksoftirqd/109:10:141
1648993529,4cyclictest25-21ksoftirqd/112:32:191
1648993529,4cyclictest25-21ksoftirqd/111:45:001
1648993529,4cyclictest25-21ksoftirqd/110:49:491
1647993530,3cyclictest9-21ksoftirqd/011:35:380
1647993530,3cyclictest9-21ksoftirqd/010:10:120
1647993529,4cyclictest9-21ksoftirqd/012:28:170
1647993529,4cyclictest9-21ksoftirqd/012:02:540
1647993529,4cyclictest9-21ksoftirqd/011:33:530
1647993529,4cyclictest9-21ksoftirqd/011:20:570
1647993529,4cyclictest9-21ksoftirqd/008:03:560
1647993528,4cyclictest9-21ksoftirqd/009:21:140
427291340,1ptp4l401ktimersoftd/310:59:353
1650993429,3cyclictest41-21ksoftirqd/310:04:033
1650993429,3cyclictest41-21ksoftirqd/308:33:453
1650993429,3cyclictest41-21ksoftirqd/308:16:033
1650993428,4cyclictest41-21ksoftirqd/310:30:013
1650993428,4cyclictest41-21ksoftirqd/307:42:013
1649993429,3cyclictest9091-21sshd08:28:442
1649993429,3cyclictest33-21ksoftirqd/207:48:412
1649993428,4cyclictest33-21ksoftirqd/212:13:552
1649993428,4cyclictest33-21ksoftirqd/211:47:362
1649993428,4cyclictest33-21ksoftirqd/211:08:402
1649993428,4cyclictest33-21ksoftirqd/211:08:402
1649993428,4cyclictest33-21ksoftirqd/211:00:452
1649993428,4cyclictest33-21ksoftirqd/210:45:532
1649993428,4cyclictest33-21ksoftirqd/210:25:472
1649993428,4cyclictest33-21ksoftirqd/210:08:022
1649993428,4cyclictest33-21ksoftirqd/210:08:022
1649993428,3cyclictest33-21ksoftirqd/209:00:002
1649993426,5cyclictest33-21ksoftirqd/207:57:532
1648993429,3cyclictest25-21ksoftirqd/110:40:371
1648993429,3cyclictest25-21ksoftirqd/108:10:021
1648993428,4cyclictest25-21ksoftirqd/111:53:321
1648993428,4cyclictest25-21ksoftirqd/110:55:431
1648993428,4cyclictest25-21ksoftirqd/109:25:521
1648993427,4cyclictest25-21ksoftirqd/111:11:391
1648993427,4cyclictest25-21ksoftirqd/111:06:291
1648993427,4cyclictest25-21ksoftirqd/111:06:291
1647993429,3cyclictest9-21ksoftirqd/011:00:390
1647993429,3cyclictest9-21ksoftirqd/010:53:350
1647993429,3cyclictest9-21ksoftirqd/009:06:370
1647993429,3cyclictest9-21ksoftirqd/009:06:370
1647993428,4cyclictest9-21ksoftirqd/010:55:380
1647993428,4cyclictest9-21ksoftirqd/009:42:280
1647993428,4cyclictest9-21ksoftirqd/009:13:400
1647993427,4cyclictest9-21ksoftirqd/010:42:260
1647993427,4cyclictest9-21ksoftirqd/007:34:520
1650993327,4cyclictest41-21ksoftirqd/312:16:483
1650993327,4cyclictest41-21ksoftirqd/312:14:473
1650993327,4cyclictest41-21ksoftirqd/311:40:543
1650993327,4cyclictest41-21ksoftirqd/309:36:583
1650993327,4cyclictest41-21ksoftirqd/309:36:583
1650993327,4cyclictest41-21ksoftirqd/307:16:013
1649993328,3cyclictest33-21ksoftirqd/208:16:132
1649993327,4cyclictest33-21ksoftirqd/211:57:332
1649993327,4cyclictest33-21ksoftirqd/211:27:132
1649993327,4cyclictest33-21ksoftirqd/209:03:152
1649993327,4cyclictest33-21ksoftirqd/207:20:372
1649993327,4cyclictest33-21ksoftirqd/207:18:282
1649993327,3cyclictest33-21ksoftirqd/211:00:002
1648993328,3cyclictest25-21ksoftirqd/107:20:351
1648993327,4cyclictest25-21ksoftirqd/109:15:501
1648993327,4cyclictest25-21ksoftirqd/109:01:451
1648993327,4cyclictest25-21ksoftirqd/108:30:441
1648993327,4cyclictest25-21ksoftirqd/107:35:321
1648993327,3cyclictest25-21ksoftirqd/110:54:221
1648993326,4cyclictest25-21ksoftirqd/109:44:421
1647993328,3cyclictest9-21ksoftirqd/008:25:380
1647993328,3cyclictest9-21ksoftirqd/008:13:420
1647993327,4cyclictest9-21ksoftirqd/012:39:520
1647993326,4cyclictest9-21ksoftirqd/011:56:110
1647993312,18cyclictest4899-21iostat_ios07:15:200
1647993312,18cyclictest2563-21cut08:15:180
1650993227,3cyclictest41-21ksoftirqd/310:42:093
1650993227,3cyclictest41-21ksoftirqd/307:46:313
1650993227,3cyclictest41-21ksoftirqd/307:26:243
1650993226,4cyclictest41-21ksoftirqd/312:33:183
1649993227,3cyclictest33-21ksoftirqd/209:57:122
1649993227,3cyclictest33-21ksoftirqd/209:33:582
1649993227,3cyclictest33-21ksoftirqd/209:10:012
1649993227,3cyclictest33-21ksoftirqd/207:27:072
1649993226,4cyclictest33-21ksoftirqd/212:26:482
1649993226,4cyclictest33-21ksoftirqd/210:41:362
1649993226,4cyclictest33-21ksoftirqd/209:24:332
1649993226,3cyclictest33-21ksoftirqd/208:34:122
1648993227,3cyclictest25-21ksoftirqd/110:15:001
1648993226,4cyclictest25-21ksoftirqd/109:23:161
1647993227,3cyclictest9-21ksoftirqd/012:21:410
1647993227,3cyclictest9-21ksoftirqd/009:37:070
1647993227,3cyclictest9-21ksoftirqd/009:37:070
1647993226,4cyclictest9-21ksoftirqd/012:14:410
1647993226,4cyclictest9-21ksoftirqd/010:22:440
1647993226,4cyclictest9-21ksoftirqd/007:41:210
1647993212,3cyclictest1953-21iostat11:25:190
1650993125,4cyclictest41-21ksoftirqd/311:05:473
1650993125,4cyclictest41-21ksoftirqd/311:05:473
1650993125,4cyclictest41-21ksoftirqd/309:29:323
1649993126,3cyclictest33-21ksoftirqd/208:50:432
1649993125,4cyclictest33-21ksoftirqd/210:23:382
1649993125,4cyclictest33-21ksoftirqd/210:15:042
1648993126,3cyclictest25-21ksoftirqd/108:18:361
1648993126,3cyclictest25-21ksoftirqd/108:05:441
1648993126,3cyclictest25-21ksoftirqd/108:05:441
1648993125,4cyclictest25-21ksoftirqd/108:50:111
1648993125,4cyclictest21678-21cron07:50:011
1647993126,3cyclictest9-21ksoftirqd/011:07:110
1647993126,3cyclictest9-21ksoftirqd/011:07:110
1647993126,3cyclictest9-21ksoftirqd/008:50:110
1647993124,4cyclictest9-21ksoftirqd/009:28:240
1647993112,16cyclictest27699-21latency_hist10:10:000
1647993112,16cyclictest27699-21latency_hist10:10:000
1647993111,3cyclictest10780-21sed08:30:250
1647993111,17cyclictest2142-21hddtemp_smartct12:30:170
427291300,0ptp4l401ktimersoftd/308:51:373
1650993025,3cyclictest41-21ksoftirqd/311:31:543
1650993025,3cyclictest41-21ksoftirqd/310:54:103
1650993025,3cyclictest41-21ksoftirqd/310:22:363
1650993024,4cyclictest41-21ksoftirqd/311:45:323
1649993024,4cyclictest33-21ksoftirqd/210:50:462
1648993023,4cyclictest25-21ksoftirqd/112:20:591
1650992923,4cyclictest41-21ksoftirqd/309:40:383
1649992924,3cyclictest33-21ksoftirqd/211:16:162
1649992924,3cyclictest33-21ksoftirqd/208:01:162
1649992923,4cyclictest33-21ksoftirqd/211:53:322
1649992922,5cyclictest33-21ksoftirqd/209:44:552
1648992924,3cyclictest25-21ksoftirqd/111:21:571
1648992924,3cyclictest25-21ksoftirqd/108:57:071
1648992924,3cyclictest25-21ksoftirqd/107:54:011
164799298,3cyclictest24736-21expr07:55:150
1647992924,3cyclictest9-21ksoftirqd/010:45:110
1647992924,3cyclictest9-21ksoftirqd/007:26:040
164799291,2cyclictest121rcu_preempt10:26:020
1649992823,3cyclictest33-21ksoftirqd/208:24:182
1649992823,3cyclictest33-21ksoftirqd/207:38:022
1648992823,3cyclictest25-21ksoftirqd/108:28:001
1648992822,4cyclictest25-21ksoftirqd/111:34:291
164799287,3cyclictest13464-21proc_pri08:35:240
164799287,3cyclictest13464-21proc_pri08:35:240
1647992823,3cyclictest9-21ksoftirqd/012:16:260
1647992822,4cyclictest9-21ksoftirqd/009:51:350
1647992822,4cyclictest9-21ksoftirqd/008:44:150
1649992721,4cyclictest33-21ksoftirqd/208:40:002
1649992721,4cyclictest33-21ksoftirqd/208:40:002
1647992711,3cyclictest9700-21ptp4l10:35:280
1649992620,3cyclictest33-21ksoftirqd/208:05:562
1649992620,3cyclictest33-21ksoftirqd/208:05:562
1648992621,3cyclictest25-21ksoftirqd/111:45:401
1647992621,3cyclictest9-21ksoftirqd/008:45:120
1647992621,3cyclictest9-21ksoftirqd/008:21:120
164799261,7cyclictest24147-21phc2sys10:00:230
1649992519,4cyclictest33-21ksoftirqd/210:32:172
164799247,3cyclictest23264-21latency_hist12:10:000
164799241,5cyclictest22607-21turbostat.cron10:00:000
1647992317,4cyclictest9-21ksoftirqd/011:19:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional