You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-19 - 05:01
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rackdslot3.osadl.org (updated Fri Apr 19, 2024 00:46:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1813222730,8sleep00-21swapper/019:05:100
8255911830,6ptp4l401ktimersoftd/319:08:293
128242860,4sleep212828-21unixbench_singl23:25:312
61602680,1sleep30-21swapper/323:15:003
228862670,4sleep09-21ksoftirqd/022:40:240
264432650,5sleep226447-21ptp4l19:20:292
264432650,5sleep226447-21ptp4l19:20:292
20477996431,9cyclictest9-21ksoftirqd/019:22:170
20477996431,9cyclictest9-21ksoftirqd/019:22:160
825591620,1ptp4l401ktimersoftd/321:56:483
825591620,1ptp4l401ktimersoftd/321:11:063
825591600,1ptp4l401ktimersoftd/320:15:243
825591600,1ptp4l401ktimersoftd/300:17:193
825591590,1ptp4l401ktimersoftd/319:11:393
165972570,2sleep20-21swapper/220:10:152
825591560,2ptp4l30599-21/usr/sbin/munin21:50:303
129692550,2sleep10-21swapper/122:20:141
129692550,2sleep10-21swapper/122:20:131
200862542,40sleep20-21swapper/219:08:402
2047799533,6cyclictest9-21ksoftirqd/020:35:000
20477995310,6cyclictest9-21ksoftirqd/023:45:190
20477995310,6cyclictest9-21ksoftirqd/023:45:180
20480995144,4cyclictest41-21ksoftirqd/320:35:003
2047799513,6cyclictest9-21ksoftirqd/022:50:300
825591500,2ptp4l0-21swapper/323:15:323
825591500,1ptp4l401ktimersoftd/320:44:493
2047799505,6cyclictest9-21ksoftirqd/020:50:160
2047799505,6cyclictest9-21ksoftirqd/020:50:150
20477995030,8cyclictest9-21ksoftirqd/023:59:070
20477995021,9cyclictest9-21ksoftirqd/021:30:110
2000325030,9sleep10-21swapper/119:07:331
20479994931,15cyclictest33-21ksoftirqd/222:49:342
20478994943,3cyclictest25-21ksoftirqd/121:35:001
2047799493,6cyclictest9-21ksoftirqd/021:15:280
2047799493,6cyclictest9-21ksoftirqd/021:05:290
2047799493,6cyclictest9-21ksoftirqd/019:45:160
20477994929,8cyclictest9-21ksoftirqd/020:22:400
20477994917,10cyclictest9-21ksoftirqd/020:55:280
2047799484,6cyclictest9-21ksoftirqd/000:20:270
2047799483,6cyclictest9-21ksoftirqd/022:45:320
2047799483,6cyclictest9-21ksoftirqd/019:53:530
2047799483,5cyclictest9-21ksoftirqd/023:53:050
2047799483,5cyclictest9-21ksoftirqd/023:25:300
2047799483,5cyclictest9-21ksoftirqd/021:20:210
2047799483,5cyclictest9-21ksoftirqd/020:11:190
20477994816,10cyclictest9-21ksoftirqd/021:40:230
249442470,2sleep324946-21sendmail_mailst21:35:273
20480994741,3cyclictest41-21ksoftirqd/319:30:003
2047799473,6cyclictest9-21ksoftirqd/021:51:040
2047799473,5cyclictest9-21ksoftirqd/022:55:590
2047799473,5cyclictest9-21ksoftirqd/022:12:110
2047799473,5cyclictest9-21ksoftirqd/019:31:480
2047799472,6cyclictest9-21ksoftirqd/020:25:190
2047799472,5cyclictest9-21ksoftirqd/023:20:250
2047799472,5cyclictest9-21ksoftirqd/019:17:440
2047799470,7cyclictest9-21ksoftirqd/019:25:110
20479994629,14cyclictest33-21ksoftirqd/222:42:472
20478994640,3cyclictest25-21ksoftirqd/122:50:011
2047799463,5cyclictest9-21ksoftirqd/022:22:470
2047799463,5cyclictest9-21ksoftirqd/022:22:470
2047799462,6cyclictest9-21ksoftirqd/000:15:310
20477994623,4cyclictest9-21ksoftirqd/000:08:040
825591450,1ptp4l401ktimersoftd/300:22:093
20478994539,3cyclictest25-21ksoftirqd/119:35:001
2047799454,5cyclictest9-21ksoftirqd/020:41:590
2047799453,6cyclictest9-21ksoftirqd/022:15:340
2047799453,6cyclictest9-21ksoftirqd/022:15:330
2047799453,5cyclictest9-21ksoftirqd/019:12:170
20477994527,9cyclictest9-21ksoftirqd/000:34:050
20477994527,6cyclictest9-21ksoftirqd/021:59:400
2047799452,6cyclictest9-21ksoftirqd/023:40:260
20477994518,4cyclictest9-21ksoftirqd/020:00:410
825591440,12ptp4l401ktimersoftd/319:47:363
316832440,3sleep20-21swapper/221:50:242
20480994438,3cyclictest41-21ksoftirqd/323:00:003
20480994437,4cyclictest3654-21sh23:09:593
20478994438,4cyclictest25-21ksoftirqd/122:05:001
2047799443,6cyclictest9-21ksoftirqd/021:13:060
20477994431,6cyclictest9-21ksoftirqd/023:39:350
2047799442,5cyclictest9-21ksoftirqd/021:37:230
2047799433,5cyclictest9-21ksoftirqd/000:35:360
20477994329,6cyclictest9-21ksoftirqd/022:34:160
20477994327,4cyclictest9-21ksoftirqd/022:36:590
20477994324,8cyclictest9-21ksoftirqd/020:17:340
20478994236,3cyclictest25-21ksoftirqd/123:20:001
20478994236,3cyclictest25-21ksoftirqd/122:40:001
20478994235,4cyclictest25-21ksoftirqd/121:50:001
20478994235,4cyclictest25-21ksoftirqd/121:00:021
2047799425,6cyclictest9-21ksoftirqd/021:00:250
2047799424,5cyclictest9-21ksoftirqd/000:26:370
20477994236,4cyclictest9-21ksoftirqd/019:40:180
20477994230,4cyclictest9-21ksoftirqd/023:19:110
20477994229,6cyclictest9-21ksoftirqd/023:30:400
20477994224,9cyclictest9-21ksoftirqd/022:00:080
20477994224,9cyclictest9-21ksoftirqd/020:07:350
20480994134,4cyclictest41-21ksoftirqd/319:40:003
20479994123,15cyclictest33-21ksoftirqd/223:57:432
20478994135,3cyclictest25-21ksoftirqd/123:40:001
20478994134,4cyclictest25-21ksoftirqd/123:45:271
20478994134,4cyclictest25-21ksoftirqd/123:45:261
20478994134,4cyclictest25-21ksoftirqd/122:50:221
20478994134,4cyclictest25-21ksoftirqd/100:20:011
20477994129,5cyclictest9-21ksoftirqd/023:14:510
20477994127,6cyclictest9-21ksoftirqd/023:01:470
20477994127,6cyclictest9-21ksoftirqd/022:07:180
20477994122,6cyclictest9-21ksoftirqd/020:48:540
20480994035,3cyclictest41-21ksoftirqd/321:35:003
20480994033,4cyclictest41-21ksoftirqd/319:50:133
20479994024,13cyclictest33-21ksoftirqd/200:31:152
20479994012,25cyclictest15926-21basename20:10:002
20479994011,26cyclictest7768-21cat22:10:102
20478994035,3cyclictest25-21ksoftirqd/100:05:001
20478994034,4cyclictest25-21ksoftirqd/100:32:571
20478994033,4cyclictest25-21ksoftirqd/123:35:001
20478994033,4cyclictest25-21ksoftirqd/100:00:001
2047799403,6cyclictest9-21ksoftirqd/021:25:150
20477994035,3cyclictest9-21ksoftirqd/023:10:000
825591390,1ptp4l401ktimersoftd/321:30:013
20480993926,8cyclictest41-21ksoftirqd/321:20:093
20479993932,4cyclictest33-21ksoftirqd/221:38:582
2047999390,5cyclictest20668-21tr23:45:142
2047999390,5cyclictest20668-21tr23:45:142
20478993934,3cyclictest25-21ksoftirqd/120:40:001
20478993933,4cyclictest25-21ksoftirqd/123:40:581
20478993933,3cyclictest25-21ksoftirqd/121:00:001
825591380,1ptp4l401ktimersoftd/320:57:523
20480993822,10cyclictest41-21ksoftirqd/319:40:133
20479993829,5cyclictest33-21ksoftirqd/220:58:582
20479993821,14cyclictest33-21ksoftirqd/220:31:432
20479993810,25cyclictest27494-21cat21:40:282
2047999380,4cyclictest7493-21fschecks_time00:25:182
20478993832,4cyclictest25-21ksoftirqd/123:50:301
20478993832,4cyclictest25-21ksoftirqd/120:34:591
20478993832,3cyclictest25-21ksoftirqd/123:10:121
20478993832,3cyclictest25-21ksoftirqd/122:05:141
20478993831,4cyclictest25-21ksoftirqd/119:40:211
20478993831,4cyclictest25-21ksoftirqd/119:40:001
20478993831,4cyclictest25-21ksoftirqd/119:15:121
20477993833,3cyclictest9-21ksoftirqd/000:00:280
20480993731,4cyclictest41-21ksoftirqd/300:05:533
20480993730,4cyclictest41-21ksoftirqd/322:38:013
20480993728,6cyclictest41-21ksoftirqd/323:37:323
2047999379,24cyclictest28658-21processes00:00:252
20479993730,4cyclictest33-21ksoftirqd/223:32:322
20479993730,4cyclictest33-21ksoftirqd/221:21:412
20479993730,4cyclictest33-21ksoftirqd/221:11:342
20479993729,5cyclictest33-21ksoftirqd/200:20:002
20479993722,8cyclictest0-21swapper/221:15:112
20479993720,14cyclictest33-21ksoftirqd/200:38:502
20479993712,22cyclictest14248-21seq22:20:462
20479993712,22cyclictest14248-21seq22:20:452
20479993710,24cyclictest21205-21sed22:35:322
20479993710,23cyclictest30540-21sed20:40:142
20478993731,4cyclictest25-21ksoftirqd/123:25:001
20478993731,4cyclictest25-21ksoftirqd/121:15:011
20478993731,3cyclictest25-21ksoftirqd/123:00:001
20478993731,3cyclictest25-21ksoftirqd/122:20:001
20478993731,3cyclictest25-21ksoftirqd/122:20:001
20478993731,3cyclictest25-21ksoftirqd/100:10:001
20478993730,4cyclictest25-21ksoftirqd/120:50:121
20478993730,4cyclictest25-21ksoftirqd/120:50:111
20478993730,4cyclictest25-21ksoftirqd/120:49:001
20478993730,4cyclictest25-21ksoftirqd/120:00:141
20478993730,4cyclictest25-21ksoftirqd/119:55:271
20478993724,10cyclictest15300-21meminfo21:15:231
20477993732,3cyclictest9-21ksoftirqd/000:15:000
20477993726,4cyclictest9-21ksoftirqd/022:28:110
20477993724,4cyclictest9-21ksoftirqd/019:36:180
825591360,1ptp4l401ktimersoftd/319:15:303
20480993631,3cyclictest41-21ksoftirqd/320:05:233
20480993630,4cyclictest41-21ksoftirqd/321:15:133
20480993630,4cyclictest41-21ksoftirqd/319:55:523
20480993629,4cyclictest41-21ksoftirqd/320:23:333
20479993630,3cyclictest33-21ksoftirqd/222:09:402
20479993630,3cyclictest33-21ksoftirqd/221:47:282
20479993630,3cyclictest33-21ksoftirqd/219:20:002
20479993629,4cyclictest33-21ksoftirqd/223:52:192
20479993629,4cyclictest33-21ksoftirqd/222:00:112
20479993629,4cyclictest33-21ksoftirqd/221:30:352
20479993629,4cyclictest33-21ksoftirqd/220:26:022
20479993629,4cyclictest33-21ksoftirqd/219:32:102
20479993629,4cyclictest33-21ksoftirqd/200:13:072
20479993628,5cyclictest33-21ksoftirqd/219:39:592
2047999360,5cyclictest18453-21ptp4l22:30:262
2047999360,4cyclictest924-21df_abs21:55:152
2047999360,4cyclictest27270-21fschecks_time22:50:192
20478993631,3cyclictest25-21ksoftirqd/123:00:181
20478993631,3cyclictest25-21ksoftirqd/122:45:011
20478993631,3cyclictest25-21ksoftirqd/122:30:291
20478993631,3cyclictest25-21ksoftirqd/121:45:001
20478993631,3cyclictest25-21ksoftirqd/120:10:221
20478993630,4cyclictest25-21ksoftirqd/100:20:241
20478993630,3cyclictest25-21ksoftirqd/121:52:531
20478993629,4cyclictest25-21ksoftirqd/121:30:001
20478993629,4cyclictest25-21ksoftirqd/120:18:451
20478993629,4cyclictest25-21ksoftirqd/119:45:371
20478993629,4cyclictest25-21ksoftirqd/119:20:141
20478993629,4cyclictest25-21ksoftirqd/119:20:131
20478993629,4cyclictest25-21ksoftirqd/119:10:101
20478993629,4cyclictest25-21ksoftirqd/100:26:331
825591350,9ptp4l0-21swapper/322:30:583
825591350,1ptp4l401ktimersoftd/323:55:313
825591350,1ptp4l401ktimersoftd/320:12:213
20480993530,3cyclictest41-21ksoftirqd/322:30:003
20480993529,3cyclictest41-21ksoftirqd/322:54:383
20480993529,3cyclictest41-21ksoftirqd/300:37:273
20480993528,4cyclictest41-21ksoftirqd/323:54:513
20480993528,4cyclictest41-21ksoftirqd/323:45:043
20480993528,4cyclictest41-21ksoftirqd/323:45:033
20480993528,4cyclictest41-21ksoftirqd/322:43:253
20480993528,4cyclictest41-21ksoftirqd/321:41:263
20480993528,4cyclictest41-21ksoftirqd/320:35:123
20480993528,4cyclictest41-21ksoftirqd/319:20:063
20480993528,4cyclictest41-21ksoftirqd/319:20:053
20479993528,4cyclictest33-21ksoftirqd/222:19:252
20479993528,4cyclictest33-21ksoftirqd/222:19:242
20479993528,4cyclictest33-21ksoftirqd/221:25:482
20479993528,4cyclictest33-21ksoftirqd/220:53:512
20479993528,4cyclictest33-21ksoftirqd/220:53:502
20479993528,4cyclictest33-21ksoftirqd/220:37:172
20479993528,4cyclictest33-21ksoftirqd/219:47:552
20479993528,4cyclictest33-21ksoftirqd/219:25:542
20479993512,20cyclictest31687-21id00:06:432
20479993510,22cyclictest12478-21load20:00:232
20478993529,3cyclictest25-21ksoftirqd/120:20:211
20478993528,4cyclictest25-21ksoftirqd/121:23:531
825591340,1ptp4l401ktimersoftd/322:48:143
20480993429,3cyclictest41-21ksoftirqd/320:01:523
20480993428,4cyclictest41-21ksoftirqd/322:08:123
20480993428,4cyclictest41-21ksoftirqd/320:25:183
20480993428,3cyclictest41-21ksoftirqd/321:07:403
20480993428,3cyclictest41-21ksoftirqd/300:31:013
20480993427,4cyclictest41-21ksoftirqd/323:44:303
20480993427,4cyclictest41-21ksoftirqd/323:32:583
20480993427,4cyclictest41-21ksoftirqd/320:50:013
2047999349,22cyclictest7444-21seq19:50:172
2047999348,23cyclictest15267-21df_abs22:25:122
2047999342,8cyclictest7407-21apt-get21:00:122
20479993428,3cyclictest33-21ksoftirqd/223:35:082
20479993427,4cyclictest33-21ksoftirqd/223:23:102
20479993427,4cyclictest33-21ksoftirqd/220:19:242
20479993425,6cyclictest33-21ksoftirqd/220:46:352
2047999342,26cyclictest0-21swapper/223:05:122
20479993412,19cyclictest2060-21/usr/sbin/munin19:40:142
20479993412,19cyclictest18811-21if_enp4s023:40:182
20478993429,3cyclictest25-21ksoftirqd/122:10:301
20478993428,4cyclictest25-21ksoftirqd/123:06:421
20478993428,4cyclictest25-21ksoftirqd/120:05:251
20478993428,3cyclictest25-21ksoftirqd/121:05:351
20478993428,3cyclictest25-21ksoftirqd/119:50:581
20478993428,3cyclictest25-21ksoftirqd/100:35:201
20478993427,4cyclictest25-21ksoftirqd/123:27:071
20478993427,4cyclictest25-21ksoftirqd/120:29:131
20478993427,4cyclictest25-21ksoftirqd/119:27:171
20478993422,7cyclictest25-21ksoftirqd/100:10:101
20480993327,4cyclictest41-21ksoftirqd/323:21:373
20480993327,4cyclictest41-21ksoftirqd/323:00:593
20480993327,4cyclictest41-21ksoftirqd/320:52:373
20480993327,4cyclictest41-21ksoftirqd/320:52:363
20480993327,4cyclictest41-21ksoftirqd/319:32:253
20480993327,3cyclictest41-21ksoftirqd/323:30:003
20480993327,3cyclictest41-21ksoftirqd/322:15:133
20480993327,3cyclictest41-21ksoftirqd/322:15:123
20480993327,3cyclictest41-21ksoftirqd/300:27:473
20480993320,7cyclictest41-21ksoftirqd/322:10:093
20479993326,4cyclictest33-21ksoftirqd/221:06:112
20479993326,4cyclictest33-21ksoftirqd/200:23:252
20479993311,19cyclictest29622-21perl22:55:152
20478993326,4cyclictest25-21ksoftirqd/121:55:171
20477993326,4cyclictest9-21ksoftirqd/020:39:190
825591320,1ptp4l401ktimersoftd/322:24:243
825591320,1ptp4l401ktimersoftd/322:24:243
20480993226,4cyclictest41-21ksoftirqd/300:00:453
2047999328,20cyclictest0-21swapper/223:10:122
20479993226,4cyclictest33-21ksoftirqd/219:56:532
20479993225,4cyclictest33-21ksoftirqd/223:19:042
20479993225,4cyclictest33-21ksoftirqd/220:23:322
20478993226,4cyclictest25-21ksoftirqd/121:38:151
20478993226,3cyclictest25-21ksoftirqd/122:27:541
20478993226,3cyclictest25-21ksoftirqd/120:45:001
103022320,5sleep0101ktimersoftd/019:55:220
20480993126,3cyclictest41-21ksoftirqd/321:00:223
20480993124,4cyclictest41-21ksoftirqd/322:00:153
20480993124,4cyclictest41-21ksoftirqd/321:46:233
20479993125,4cyclictest33-21ksoftirqd/219:14:242
20480993023,4cyclictest41-21ksoftirqd/300:10:113
2047999305,4cyclictest31383-21cat23:00:092
2047799304,9cyclictest9-21ksoftirqd/021:45:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional