You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-21 - 05:50
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rackdslot4.osadl.org (updated Tue Oct 21, 2025 00:45:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
134791229161,23phc2sys0-21swapper/319:09:543
134791229161,23phc2sys0-21swapper/319:09:533
83002204169,23sleep10-21swapper/119:08:531
83002204169,23sleep10-21swapper/119:08:531
82122200166,22sleep00-21swapper/019:07:430
82122200166,22sleep00-21swapper/019:07:430
80932200166,23sleep20-21swapper/219:06:212
80932200166,23sleep20-21swapper/219:06:212
134991880,1ptp4l20778-1kworker/3:0H00:35:333
134991850,7ptp4l868199cyclictest20:05:193
134991830,1ptp4l391rcuc/321:50:223
1347918262,11phc2sys0-21swapper/319:10:013
134991810,1ptp4l391rcuc/321:20:223
134991810,1ptp4l391rcuc/321:20:223
134991800,1ptp4l0-21swapper/321:37:573
134991790,1ptp4l391rcuc/323:15:133
134991790,1ptp4l391rcuc/320:15:273
134991780,2ptp4l391rcuc/300:05:133
134991760,2ptp4l391rcuc/323:35:013
134991750,1ptp4l391rcuc/320:13:503
134991740,2ptp4l391rcuc/320:50:273
134991740,2ptp4l391rcuc/300:25:223
134991730,1ptp4l391rcuc/320:33:493
134991720,2ptp4l391rcuc/320:40:153
134991720,1ptp4l391rcuc/323:11:003
134991720,1ptp4l391rcuc/323:05:143
134991720,1ptp4l391rcuc/322:30:213
134991720,1ptp4l391rcuc/322:15:243
134991710,1ptp4l391rcuc/322:49:363
134991700,1ptp4l391rcuc/320:48:403
134991660,1ptp4l391rcuc/321:28:203
134991660,1ptp4l0-21swapper/322:12:483
134991650,1ptp4l391rcuc/321:00:163
867899635,11cyclictest10705-21latency_hist21:25:000
867899635,11cyclictest10705-21latency_hist21:25:000
242182610,2sleep20-21swapper/221:55:172
134991610,1ptp4l0-21swapper/323:27:193
867899594,15cyclictest1307-21latency_hist22:15:010
134991590,6ptp4l868199cyclictest19:25:283
867899581,11cyclictest0-21swapper/023:00:000
867899581,11cyclictest0-21swapper/023:00:000
214412580,2sleep20-21swapper/200:00:152
134991580,1ptp4l391rcuc/300:33:163
867899576,9cyclictest6854-21grep23:30:160
867899576,10cyclictest27114-21grep22:00:170
867899574,10cyclictest19862-21phc2sys-jitter20:35:240
867899572,10cyclictest31391-21latency_hist00:20:000
134991570,1ptp4l391rcuc/322:23:283
134991570,1ptp4l391rcuc/321:09:373
134991570,1ptp4l391rcuc/319:59:043
867899561,9cyclictest0-21swapper/023:50:000
134991560,1ptp4l391rcuc/323:00:183
134991560,1ptp4l391rcuc/321:15:283
134991560,1ptp4l0-21swapper/323:57:253
134991550,1ptp4l391rcuc/323:53:483
134991550,1ptp4l391rcuc/323:46:253
134991550,1ptp4l391rcuc/323:42:593
134991550,1ptp4l391rcuc/322:50:253
134991550,1ptp4l391rcuc/320:56:413
134991550,1ptp4l391rcuc/320:00:443
134991550,1ptp4l391rcuc/319:18:243
867899545,9cyclictest4569-21fschecks_time00:30:160
867899542,10cyclictest4864-21irqrtprio23:25:240
867899542,10cyclictest21930-21irqrtprio19:35:200
134991540,1ptp4l391rcuc/322:55:223
134991540,1ptp4l391rcuc/322:55:213
134991540,1ptp4l391rcuc/322:00:173
134991540,1ptp4l391rcuc/321:48:133
134991540,1ptp4l391rcuc/320:20:303
134991540,1ptp4l391rcuc/320:20:303
134991540,1ptp4l391rcuc/319:22:223
867899533,11cyclictest29532-21irqrtprio23:10:190
867899531,16cyclictest17422-21proc_pri20:30:260
867899530,15cyclictest0-21swapper/020:03:000
173562530,3sleep20-21swapper/219:25:222
134991530,1ptp4l391rcuc/323:33:443
134991530,1ptp4l391rcuc/322:35:543
134991530,1ptp4l391rcuc/321:32:243
134991530,1ptp4l391rcuc/321:13:013
134991530,1ptp4l391rcuc/320:38:393
134991530,1ptp4l391rcuc/320:25:233
134991530,1ptp4l391rcuc/319:46:203
134991530,1ptp4l391rcuc/319:43:383
134991530,1ptp4l391rcuc/319:35:433
134991530,1ptp4l391rcuc/319:32:203
134991530,1ptp4l391rcuc/300:01:313
134991530,1ptp4l0-21swapper/323:21:543
867899522,10cyclictest17552-21sendmail_mailqu19:25:230
134991520,1ptp4l391rcuc/322:26:183
134991520,1ptp4l391rcuc/322:09:483
134991520,1ptp4l391rcuc/321:56:313
134991520,1ptp4l391rcuc/321:41:423
134991520,1ptp4l391rcuc/319:54:543
134991520,1ptp4l391rcuc/300:21:243
134991520,1ptp4l391rcuc/300:14:043
867899516,9cyclictest13879-21ls19:20:160
867899516,10cyclictest7745-21tail21:15:300
867899514,9cyclictest28911-21tune2fs20:55:160
867899511,11cyclictest21796-21cpuspeed_turbos21:50:130
134991510,1ptp4l391rcuc/322:43:353
134991510,1ptp4l391rcuc/300:19:543
867899504,16cyclictest20470-21sed22:50:250
867899501,16cyclictest0-21swapper/020:05:170
867899500,10cyclictest0-21swapper/019:15:250
867899497,16cyclictest18982-21df_abs19:30:170
867899491,17cyclictest0-21swapper/022:35:190
867899490,17cyclictest0-21swapper/022:25:180
867899483,11cyclictest24168-21expr23:00:170
867899481,16cyclictest0-21swapper/020:40:150
867899476,8cyclictest11545-21df20:20:170
867899476,8cyclictest11545-21df20:20:160
867899472,10cyclictest0-21swapper/022:30:280
867899465,8cyclictest27737-21switchtime19:45:300
867899463,16cyclictest31731-21cat19:55:190
867899455,7cyclictest1763-21df23:20:160
867899454,8cyclictest31136-21sshd22:08:390
867899454,7cyclictest25100-21irqstats21:55:230
867899454,15cyclictest14319-21if_err_enp4s021:30:190
867899448,11cyclictest2156-21cat21:05:220
867899445,8cyclictest4249-21iostat_ios21:10:180
867899445,6cyclictest19632-21iostat_ios23:55:180
867899443,9cyclictest32252-21irqstats23:15:190
867899434,7cyclictest27059-21meminfo20:50:220
867899433,8cyclictest7606-21ptp4l20:10:230
867899431,7cyclictest8590-21apt-get23:35:030
867899431,10cyclictest0-21swapper/023:05:290
8679994236,3cyclictest25-21ksoftirqd/123:40:011
867899424,7cyclictest9276-21hddtemp_smartct20:15:190
867899423,8cyclictest15124-21memory22:40:210
867899421,8cyclictest17571-21ls22:45:200
8679994136,3cyclictest25-21ksoftirqd/119:15:001
867899414,6cyclictest7589-21memory00:35:230
867899414,6cyclictest19540-21df21:45:150
867899413,7cyclictest32447-21irqstats00:20:210
867899413,7cyclictest17176-21diskstats21:40:130
867899411,15cyclictest3245-21ls22:15:250
8679994037,2cyclictest25-21ksoftirqd/121:20:011
8679994034,3cyclictest25-21ksoftirqd/100:20:221
8679994034,3cyclictest25-21ksoftirqd/100:05:001
8679994032,3cyclictest25-21ksoftirqd/120:30:201
867899403,6cyclictest11400-21df_inode21:25:160
8679993934,3cyclictest25-21ksoftirqd/121:40:001
8679993934,3cyclictest25-21ksoftirqd/119:45:001
867899394,6cyclictest9072-21df19:10:140
867899394,14cyclictest23708-21cstates20:45:130
8679993833,3cyclictest25-21ksoftirqd/122:25:001
8679993833,3cyclictest25-21ksoftirqd/122:15:001
8679993832,4cyclictest25-21ksoftirqd/119:15:121
8679993832,3cyclictest25-21ksoftirqd/123:00:151
8679993831,4cyclictest25-21ksoftirqd/122:10:001
867899384,16cyclictest14313-21if_err_enp1s020:25:190
867899383,7cyclictest24211-21df00:05:140
8680993731,4cyclictest33-21ksoftirqd/219:50:102
8679993733,3cyclictest25-21ksoftirqd/121:04:591
8679993733,2cyclictest25-21ksoftirqd/100:20:001
8679993732,3cyclictest25-21ksoftirqd/122:45:221
8679993732,3cyclictest25-21ksoftirqd/122:00:011
8679993732,3cyclictest23259-21dump-pmu-power20:45:011
8679993732,2cyclictest25-21ksoftirqd/123:50:011
8679993731,4cyclictest25-21ksoftirqd/121:44:251
8679993731,3cyclictest25-21ksoftirqd/123:20:001
8679993730,4cyclictest25-21ksoftirqd/123:12:311
8680993630,4cyclictest33-21ksoftirqd/223:28:132
8680993630,4cyclictest33-21ksoftirqd/219:19:322
8679993632,3cyclictest25-21ksoftirqd/119:20:221
8679993632,2cyclictest25-21ksoftirqd/121:55:001
8679993631,3cyclictest25-21ksoftirqd/123:24:591
8679993631,3cyclictest25-21ksoftirqd/121:20:181
8679993631,3cyclictest25-21ksoftirqd/121:20:181
8679993631,3cyclictest25-21ksoftirqd/120:25:131
8679993630,4cyclictest25-21ksoftirqd/123:29:281
8679993630,4cyclictest25-21ksoftirqd/121:12:521
8679993630,4cyclictest25-21ksoftirqd/100:29:541
8679993629,3cyclictest25-21ksoftirqd/123:05:201
867899364,7cyclictest3675-21sshd00:28:450
8680993530,3cyclictest33-21ksoftirqd/221:30:592
8680993529,4cyclictest33-21ksoftirqd/222:33:042
8680993529,4cyclictest33-21ksoftirqd/221:21:032
8680993529,4cyclictest33-21ksoftirqd/221:21:032
8680993529,4cyclictest33-21ksoftirqd/221:07:442
8680993528,4cyclictest33-21ksoftirqd/223:15:582
868099351,3cyclictest121rcu_preempt21:15:432
8679993531,3cyclictest25-21ksoftirqd/122:50:191
8679993530,3cyclictest25-21ksoftirqd/121:45:131
8679993530,3cyclictest25-21ksoftirqd/120:21:501
8679993530,3cyclictest25-21ksoftirqd/120:21:501
8679993530,3cyclictest25-21ksoftirqd/120:20:001
8679993530,3cyclictest25-21ksoftirqd/120:00:001
8679993530,3cyclictest25-21ksoftirqd/100:30:181
8679993530,3cyclictest25-21ksoftirqd/100:09:591
8679993529,4cyclictest25-21ksoftirqd/100:35:121
8678993530,3cyclictest9-21ksoftirqd/023:51:010
8680993430,3cyclictest33-21ksoftirqd/220:10:352
8680993429,3cyclictest33-21ksoftirqd/223:37:272
8680993429,3cyclictest33-21ksoftirqd/220:02:352
8680993428,4cyclictest33-21ksoftirqd/223:49:112
8680993428,4cyclictest33-21ksoftirqd/223:21:472
8680993428,4cyclictest33-21ksoftirqd/222:13:272
8680993428,4cyclictest33-21ksoftirqd/221:27:462
8680993428,4cyclictest33-21ksoftirqd/219:45:022
8680993428,4cyclictest33-21ksoftirqd/200:12:342
868099340,2cyclictest121rcu_preempt23:31:402
8679993429,3cyclictest25-21ksoftirqd/120:50:001
8679993429,3cyclictest25-21ksoftirqd/119:50:001
8679993428,4cyclictest25-21ksoftirqd/122:31:321
8679993428,4cyclictest25-21ksoftirqd/122:17:111
8679993428,4cyclictest25-21ksoftirqd/122:01:551
8679993428,4cyclictest25-21ksoftirqd/121:32:011
8679993428,4cyclictest25-21ksoftirqd/121:27:481
8679993428,4cyclictest25-21ksoftirqd/119:34:161
8679993428,3cyclictest25-21ksoftirqd/122:40:201
8679993428,3cyclictest25-21ksoftirqd/120:35:131
8679993427,4cyclictest25-21ksoftirqd/122:35:051
8679993427,4cyclictest25-21ksoftirqd/100:10:041
8678993428,4cyclictest9-21ksoftirqd/023:44:150
867899341,4cyclictest0-21swapper/021:03:180
8680993328,3cyclictest33-21ksoftirqd/223:42:062
8680993328,3cyclictest33-21ksoftirqd/220:42:362
8680993327,4cyclictest33-21ksoftirqd/223:13:442
8680993327,4cyclictest33-21ksoftirqd/223:02:382
8680993327,4cyclictest33-21ksoftirqd/221:03:512
8680993327,4cyclictest33-21ksoftirqd/220:31:052
8680993327,4cyclictest33-21ksoftirqd/219:56:462
8680993327,4cyclictest33-21ksoftirqd/219:21:582
8680993327,4cyclictest33-21ksoftirqd/200:22:492
8679993328,3cyclictest25-21ksoftirqd/123:50:251
8679993328,3cyclictest25-21ksoftirqd/120:51:211
8679993328,3cyclictest25-21ksoftirqd/119:50:121
8679993328,3cyclictest25-21ksoftirqd/119:35:191
8679993328,2cyclictest25-21ksoftirqd/120:05:191
8679993327,4cyclictest25-21ksoftirqd/120:11:131
8678993327,4cyclictest9-21ksoftirqd/000:01:210
8680993227,3cyclictest33-21ksoftirqd/222:15:032
8680993227,3cyclictest33-21ksoftirqd/220:15:492
8680993226,4cyclictest33-21ksoftirqd/223:58:472
8680993226,4cyclictest33-21ksoftirqd/222:07:062
8680993226,4cyclictest33-21ksoftirqd/221:49:002
8680993226,4cyclictest33-21ksoftirqd/220:48:502
8680993226,4cyclictest33-21ksoftirqd/220:26:202
8680993226,4cyclictest33-21ksoftirqd/220:06:502
8680993226,4cyclictest33-21ksoftirqd/200:19:282
8680993226,4cyclictest33-21ksoftirqd/200:07:122
8679993228,3cyclictest25-21ksoftirqd/122:55:221
8679993228,3cyclictest25-21ksoftirqd/122:55:211
8679993227,3cyclictest25-21ksoftirqd/120:00:131
8679993226,4cyclictest25-21ksoftirqd/123:32:541
8679993226,3cyclictest25-21ksoftirqd/123:45:011
8680993126,3cyclictest33-21ksoftirqd/223:53:142
8680993126,3cyclictest33-21ksoftirqd/220:37:282
8680993126,3cyclictest33-21ksoftirqd/220:21:482
8680993126,3cyclictest33-21ksoftirqd/220:21:482
8680993126,3cyclictest33-21ksoftirqd/219:44:572
8680993125,4cyclictest33-21ksoftirqd/222:45:442
8680993125,4cyclictest33-21ksoftirqd/222:39:502
8680993125,4cyclictest33-21ksoftirqd/222:29:232
8680993125,4cyclictest33-21ksoftirqd/222:02:352
8680993125,4cyclictest33-21ksoftirqd/221:54:332
8680993125,4cyclictest33-21ksoftirqd/220:54:592
8680993125,4cyclictest33-21ksoftirqd/219:36:412
8680993125,4cyclictest33-21ksoftirqd/219:10:542
8679993127,2cyclictest25-21ksoftirqd/119:30:001
8678993124,4cyclictest9-21ksoftirqd/021:38:390
8680993025,3cyclictest33-21ksoftirqd/222:52:002
8680993025,3cyclictest33-21ksoftirqd/221:43:392
8680993025,3cyclictest33-21ksoftirqd/219:34:132
8680993024,4cyclictest33-21ksoftirqd/222:58:412
8680993024,4cyclictest33-21ksoftirqd/222:58:402
8680993024,4cyclictest33-21ksoftirqd/200:32:002
8679993025,3cyclictest25-21ksoftirqd/120:55:271
8680992924,3cyclictest33-21ksoftirqd/221:36:332
8679992925,3cyclictest25-21ksoftirqd/122:25:181
8680992822,4cyclictest33-21ksoftirqd/223:09:282
8680992822,4cyclictest33-21ksoftirqd/222:21:582
8679992823,3cyclictest25-21ksoftirqd/121:05:151
8678992823,3cyclictest9-21ksoftirqd/022:23:080
8678992823,3cyclictest9-21ksoftirqd/019:52:350
8680992722,3cyclictest33-21ksoftirqd/221:10:382
8680992722,3cyclictest33-21ksoftirqd/200:37:572
8680992722,3cyclictest33-21ksoftirqd/200:29:502
8680992721,4cyclictest33-21ksoftirqd/222:43:512
8680992620,4cyclictest33-21ksoftirqd/220:56:292
8679992622,3cyclictest25-21ksoftirqd/123:55:181
8678992621,3cyclictest9-21ksoftirqd/019:40:480
867899260,17cyclictest0-21swapper/000:10:230
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional