You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-24 - 10:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot2.osadl.org (updated Wed Apr 24, 2024 00:46:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1235911810,6ptp4l401ktimersoftd/319:05:383
1236421680,6sleep12522699cyclictest19:39:211
3239121050,28sleep233-21ksoftirqd/219:26:132
188832950,3sleep118879-21sort19:44:271
25225998775,6cyclictest9-21ksoftirqd/019:45:140
2522799819,12cyclictest2594-21date23:50:002
313712790,8sleep231379-21spawn19:38:412
2522799795,14cyclictest435-21sort19:45:342
65872740,4sleep36548-21sh19:43:323
2522799747,21cyclictest6496-21fschecks_time20:30:142
25226997434,8cyclictest25-21ksoftirqd/120:30:141
25226997333,7cyclictest25-21ksoftirqd/121:30:151
25226997333,12cyclictest25-21ksoftirqd/121:40:151
25226997333,12cyclictest25-21ksoftirqd/121:40:151
240222730,5sleep324039-21spawn19:38:103
2522699727,11cyclictest25-21ksoftirqd/100:25:141
2522799707,12cyclictest3411-21awk22:40:272
2522799706,14cyclictest8384-21sed22:50:302
2522799694,15cyclictest22121-21expr23:20:232
25226996932,7cyclictest25-21ksoftirqd/121:23:381
247212690,5sleep125-21ksoftirqd/121:10:121
241872690,3sleep325224-21cyclictest19:45:183
25226996827,8cyclictest25-21ksoftirqd/123:15:241
2522799679,11cyclictest16915-21grep23:10:202
2522799678,11cyclictest4005-21df_abs20:25:142
2522799675,13cyclictest28206-21cat21:15:222
25226996730,12cyclictest25-21ksoftirqd/121:15:191
25226996727,7cyclictest25-21ksoftirqd/100:20:351
2522699667,10cyclictest25-21ksoftirqd/120:20:311
2522699665,10cyclictest25-21ksoftirqd/121:05:281
25226996632,9cyclictest25-21ksoftirqd/122:45:261
25226996628,8cyclictest25-21ksoftirqd/123:05:331
25226996628,8cyclictest25-21ksoftirqd/123:05:321
25226996628,8cyclictest25-21ksoftirqd/100:35:161
2522799655,13cyclictest8225-21/usr/sbin/munin20:35:202
2522799654,14cyclictest12175-21unixbench_multi20:40:332
2522699655,10cyclictest25-21ksoftirqd/120:25:131
25226996523,7cyclictest25-21ksoftirqd/123:50:011
2522799644,13cyclictest29587-21acpi21:20:122
2522699647,4cyclictest25-21ksoftirqd/121:00:201
2522699645,9cyclictest25-21ksoftirqd/122:25:331
25226996427,7cyclictest25-21ksoftirqd/122:40:331
2522699637,5cyclictest25-21ksoftirqd/122:30:171
2522699635,8cyclictest25-21ksoftirqd/123:55:161
2522699634,9cyclictest25-21ksoftirqd/120:35:151
2522699634,10cyclictest25-21ksoftirqd/123:40:201
2522699634,10cyclictest25-21ksoftirqd/122:10:261
25226996326,7cyclictest25-21ksoftirqd/120:15:001
25226996326,7cyclictest25-21ksoftirqd/120:15:001
34172620,5sleep05400-21spawn19:38:190
25228996249,7cyclictest41-21ksoftirqd/322:55:113
2522699627,9cyclictest25-21ksoftirqd/122:55:271
2522699627,8cyclictest25-21ksoftirqd/122:05:321
2522699626,8cyclictest25-21ksoftirqd/123:10:301
2522699626,5cyclictest25-21ksoftirqd/122:35:191
25225996250,7cyclictest9-21ksoftirqd/021:25:110
2522799614,13cyclictest12136-21cat00:10:092
2522699617,5cyclictest25-21ksoftirqd/122:50:271
2522699616,9cyclictest25-21ksoftirqd/120:55:141
2522699616,8cyclictest25-21ksoftirqd/120:50:151
2522699616,11cyclictest25-21ksoftirqd/120:10:211
2522699616,11cyclictest25-21ksoftirqd/120:10:201
2522699615,8cyclictest25-21ksoftirqd/100:10:221
2522699614,9cyclictest25-21ksoftirqd/100:30:211
2522699614,9cyclictest25-21ksoftirqd/100:30:211
2522699614,9cyclictest25-21ksoftirqd/100:10:001
2522699614,8cyclictest25-21ksoftirqd/123:00:001
25226996125,10cyclictest25-21ksoftirqd/120:45:181
123591610,1ptp4l401ktimersoftd/323:36:213
324102600,2sleep10-21swapper/119:26:271
2522699606,8cyclictest25-21ksoftirqd/123:25:151
2522699605,9cyclictest25-21ksoftirqd/122:20:321
2522699604,8cyclictest25-21ksoftirqd/100:15:301
25226996024,7cyclictest25-21ksoftirqd/120:40:261
25226996023,8cyclictest25-21ksoftirqd/123:45:131
2522699596,8cyclictest25-21ksoftirqd/121:50:181
2522699595,9cyclictest25-21ksoftirqd/100:00:121
2522699594,9cyclictest25-21ksoftirqd/122:00:171
2522699594,8cyclictest25-21ksoftirqd/123:35:351
25225995951,4cyclictest9-21ksoftirqd/021:45:010
25225995951,4cyclictest9-21ksoftirqd/021:45:000
25225995951,4cyclictest9-21ksoftirqd/019:25:070
2522699586,9cyclictest25-21ksoftirqd/123:30:131
2522699585,7cyclictest25-21ksoftirqd/121:35:261
2522699584,9cyclictest25-21ksoftirqd/121:45:171
2522699583,9cyclictest25-21ksoftirqd/122:15:201
2522699582,8cyclictest25-21ksoftirqd/123:20:261
25225995852,3cyclictest9-21ksoftirqd/019:25:010
25225995851,4cyclictest9-21ksoftirqd/019:43:570
34952570,2sleep30-21swapper/320:25:003
25228995750,4cyclictest41-21ksoftirqd/319:25:223
25228995744,7cyclictest41-21ksoftirqd/322:50:113
25226995749,4cyclictest25-21ksoftirqd/119:33:581
2522699574,10cyclictest25-21ksoftirqd/121:25:241
2522699571,9cyclictest25-21ksoftirqd/121:55:201
2522699562,9cyclictest25-21ksoftirqd/120:05:011
2522699560,9cyclictest25-21ksoftirqd/120:10:001
2522799557,45cyclictest28495-21sh19:44:382
25225995549,3cyclictest9-21ksoftirqd/023:55:000
25225995548,4cyclictest9-21ksoftirqd/020:10:300
25225995548,4cyclictest9-21ksoftirqd/020:10:300
123591550,1ptp4l391rcuc/323:33:173
25228995447,4cyclictest41-21ksoftirqd/319:25:013
25225995447,4cyclictest9-21ksoftirqd/021:15:000
25225995446,4cyclictest9-21ksoftirqd/022:25:000
25228995346,4cyclictest41-21ksoftirqd/323:55:003
25228995246,3cyclictest41-21ksoftirqd/320:20:013
25228995246,3cyclictest41-21ksoftirqd/320:20:003
25225995247,3cyclictest9-21ksoftirqd/023:50:010
25225995247,3cyclictest9-21ksoftirqd/023:30:000
25225995245,4cyclictest9-21ksoftirqd/023:20:000
25225995245,4cyclictest9-21ksoftirqd/020:50:010
57698510,10rtkit-daemon0-21swapper/321:33:493
25228995138,6cyclictest41-21ksoftirqd/320:40:123
25225995145,4cyclictest9-21ksoftirqd/022:20:010
25225995145,3cyclictest9-21ksoftirqd/023:00:000
25225995145,3cyclictest9-21ksoftirqd/021:00:000
25225995145,3cyclictest9-21ksoftirqd/000:30:010
25225995145,3cyclictest9-21ksoftirqd/000:30:000
25225995144,4cyclictest9-21ksoftirqd/023:10:140
25225995143,4cyclictest9-21ksoftirqd/023:30:130
123591510,1ptp4l401ktimersoftd/322:00:123
25225995044,4cyclictest9-21ksoftirqd/023:05:280
25225995044,4cyclictest9-21ksoftirqd/023:05:270
25225995044,3cyclictest9-21ksoftirqd/021:55:000
25225995044,3cyclictest9-21ksoftirqd/021:25:000
25225995044,3cyclictest9-21ksoftirqd/000:05:010
25225995043,4cyclictest9-21ksoftirqd/020:55:010
2461425029,10sleep20-21swapper/219:05:522
25228994936,7cyclictest41-21ksoftirqd/323:15:113
25225994944,3cyclictest9-21ksoftirqd/021:15:040
25225994943,4cyclictest9-21ksoftirqd/020:40:130
25225994943,4cyclictest9-21ksoftirqd/020:20:200
25225994943,3cyclictest9-21ksoftirqd/023:59:590
25225994943,3cyclictest9-21ksoftirqd/023:20:300
25225994942,4cyclictest9-21ksoftirqd/020:20:000
25225994942,4cyclictest9-21ksoftirqd/020:20:000
25228994835,7cyclictest41-21ksoftirqd/323:55:123
25225994842,4cyclictest9-21ksoftirqd/023:35:310
25225994842,3cyclictest9-21ksoftirqd/022:40:000
25225994841,4cyclictest1-21systemd22:00:100
123591480,1ptp4l401ktimersoftd/321:55:363
25228994742,3cyclictest41-21ksoftirqd/323:10:013
25228994742,3cyclictest41-21ksoftirqd/323:10:003
25225994741,3cyclictest9-21ksoftirqd/022:15:000
25225994741,3cyclictest9-21ksoftirqd/020:40:000
25228994641,3cyclictest41-21ksoftirqd/300:00:293
25228994640,3cyclictest41-21ksoftirqd/319:55:353
25228994639,4cyclictest41-21ksoftirqd/319:55:003
2522699464,8cyclictest30801-21wc19:46:321
25225994640,4cyclictest9-21ksoftirqd/020:00:220
25225994639,4cyclictest9-21ksoftirqd/000:35:360
25228994540,3cyclictest41-21ksoftirqd/320:35:003
25228994540,3cyclictest41-21ksoftirqd/300:25:003
25228994538,4cyclictest41-21ksoftirqd/322:40:153
25228994538,4cyclictest41-21ksoftirqd/321:50:153
25227994532,10cyclictest33-21ksoftirqd/221:32:462
2522799452,11cyclictest23504-21runrttasks00:33:242
2522799452,11cyclictest23504-21runrttasks00:33:232
25227994510,18cyclictest1126-21runrttasks00:15:202
25225994540,3cyclictest9-21ksoftirqd/021:45:010
25225994540,3cyclictest9-21ksoftirqd/021:00:170
25225994539,4cyclictest9-21ksoftirqd/019:55:000
25225994539,3cyclictest9-21ksoftirqd/023:45:000
25225994538,4cyclictest9-21ksoftirqd/022:00:000
25225994538,4cyclictest9-21ksoftirqd/000:20:220
25225994538,3cyclictest9-21ksoftirqd/022:25:160
25225994537,4cyclictest9-21ksoftirqd/022:45:150
25225994537,4cyclictest9-21ksoftirqd/022:34:590
2475224515,19sleep10-21swapper/119:07:331
25228994439,3cyclictest41-21ksoftirqd/300:25:313
25228994438,4cyclictest41-21ksoftirqd/320:15:003
25228994438,4cyclictest41-21ksoftirqd/320:15:003
25228994438,3cyclictest41-21ksoftirqd/319:30:143
25228994438,3cyclictest41-21ksoftirqd/319:20:003
25228994437,4cyclictest41-21ksoftirqd/300:30:143
25228994437,4cyclictest41-21ksoftirqd/300:30:133
2522799447,19cyclictest208-21systemd-journal21:10:572
25226994439,2cyclictest241ktimersoftd/119:50:311
25225994438,4cyclictest9-21ksoftirqd/019:30:310
25225994438,4cyclictest9-21ksoftirqd/000:19:590
25225994438,3cyclictest9-21ksoftirqd/023:05:010
25225994437,4cyclictest9-21ksoftirqd/022:10:010
25225994437,4cyclictest9-21ksoftirqd/000:30:010
25225994436,4cyclictest9-21ksoftirqd/022:50:130
2479124423,10sleep00-21swapper/019:08:040
25228994337,4cyclictest41-21ksoftirqd/320:25:093
25228994336,4cyclictest41-21ksoftirqd/321:45:003
25228994336,4cyclictest41-21ksoftirqd/321:45:003
25228994336,4cyclictest41-21ksoftirqd/300:05:323
2522799435,11cyclictest25262-21snmpd19:30:272
25227994336,4cyclictest25961-21cron00:40:002
25225994338,3cyclictest9-21ksoftirqd/019:15:010
25225994337,4cyclictest9-21ksoftirqd/020:35:000
25225994337,3cyclictest9-21ksoftirqd/019:55:350
25225994337,3cyclictest9-21ksoftirqd/019:20:000
25225994336,4cyclictest9-21ksoftirqd/020:25:230
25228994236,3cyclictest42350irq/97-enp4s0-T23:48:143
25228994236,3cyclictest41-21ksoftirqd/300:40:003
25227994235,4cyclictest33-21ksoftirqd/220:10:112
25227994235,4cyclictest33-21ksoftirqd/220:10:102
2522699423,8cyclictest25-21ksoftirqd/119:14:541
25225994236,4cyclictest9-21ksoftirqd/021:40:000
25225994236,4cyclictest9-21ksoftirqd/021:05:230
25225994236,3cyclictest9-21ksoftirqd/021:34:590
25225994235,4cyclictest9-21ksoftirqd/022:40:100
25228994135,4cyclictest41-21ksoftirqd/322:45:223
25228994135,3cyclictest41-21ksoftirqd/323:25:003
25228994135,3cyclictest41-21ksoftirqd/321:25:003
2522899410,8cyclictest121rcu_preempt21:10:163
2522699413,9cyclictest25-21ksoftirqd/119:24:531
25225994135,4cyclictest9-21ksoftirqd/020:05:210
25225994135,3cyclictest9-21ksoftirqd/000:10:220
123591410,1ptp4l401ktimersoftd/321:05:283
2522899404,3cyclictest121rcu_preempt23:05:013
25228994035,3cyclictest41-21ksoftirqd/322:10:223
25228994035,3cyclictest41-21ksoftirqd/321:30:003
25228994035,3cyclictest41-21ksoftirqd/320:10:013
25228994034,4cyclictest41-21ksoftirqd/321:40:003
25228994033,4cyclictest41-21ksoftirqd/321:03:163
25228994033,4cyclictest41-21ksoftirqd/320:55:313
25227994032,5cyclictest33-21ksoftirqd/222:49:322
1236914033,3phc2sys41-21ksoftirqd/322:35:313
25228993934,3cyclictest41-21ksoftirqd/321:19:593
25228993934,3cyclictest41-21ksoftirqd/320:55:003
25228993933,4cyclictest41-21ksoftirqd/320:03:503
25228993932,4cyclictest41-21ksoftirqd/323:13:593
25228993932,4cyclictest41-21ksoftirqd/300:17:443
25228993931,5cyclictest41-21ksoftirqd/323:41:433
25228993929,7cyclictest41-21ksoftirqd/320:50:013
25227993933,4cyclictest33-21ksoftirqd/222:35:342
25227993932,4cyclictest33-21ksoftirqd/219:59:342
25225993933,4cyclictest9-21ksoftirqd/000:05:340
2522899385,3cyclictest121rcu_preempt21:50:003
25228993833,3cyclictest41-21ksoftirqd/320:39:593
25228993830,5cyclictest41-21ksoftirqd/322:25:533
2522799388,13cyclictest30320-21cstates22:30:142
2522799384,19cyclictest0-21swapper/200:20:112
25227993832,3cyclictest33-21ksoftirqd/223:55:112
25227993832,3cyclictest208-21systemd-journal19:17:002
25227993831,4cyclictest33-21ksoftirqd/223:36:172
25227993831,4cyclictest33-21ksoftirqd/223:32:512
2522699382,4cyclictest25-21ksoftirqd/119:57:551
25228993731,4cyclictest41-21ksoftirqd/322:15:213
25228993731,4cyclictest41-21ksoftirqd/322:05:293
2522799376,20cyclictest0-21swapper/220:05:322
2522799375,22cyclictest20674-21apache223:43:082
25227993730,4cyclictest33-21ksoftirqd/221:52:352
25227993730,4cyclictest33-21ksoftirqd/221:42:482
25227993730,4cyclictest33-21ksoftirqd/221:42:472
25227993730,4cyclictest33-21ksoftirqd/221:06:172
25227993730,4cyclictest33-21ksoftirqd/219:12:562
25227993729,5cyclictest33-21ksoftirqd/220:22:462
25228993631,3cyclictest41-21ksoftirqd/323:25:293
25227993630,3cyclictest33-21ksoftirqd/221:03:362
25227993630,3cyclictest33-21ksoftirqd/200:25:012
25227993629,4cyclictest33-21ksoftirqd/222:19:042
25227993629,4cyclictest33-21ksoftirqd/219:23:292
123591360,1ptp4l401ktimersoftd/322:30:113
2522799357,13cyclictest4338-21cpuspeed_turbos21:35:132
25227993529,4cyclictest33-21ksoftirqd/223:52:102
25227993528,4cyclictest33-21ksoftirqd/223:25:042
25227993528,4cyclictest33-21ksoftirqd/223:16:412
25227993528,4cyclictest33-21ksoftirqd/222:24:592
25227993528,4cyclictest33-21ksoftirqd/220:47:502
25227993528,4cyclictest33-21ksoftirqd/200:02:342
96492340,2sleep20-21swapper/222:55:142
25228993427,4cyclictest41-21ksoftirqd/322:25:003
25227993428,3cyclictest33-21ksoftirqd/222:26:362
25227993427,4cyclictest33-21ksoftirqd/220:00:442
25227993427,4cyclictest33-21ksoftirqd/219:54:292
25227993427,4cyclictest33-21ksoftirqd/200:07:092
123591340,1ptp4l401ktimersoftd/300:10:213
25227993326,4cyclictest33-21ksoftirqd/221:48:372
25227993326,4cyclictest33-21ksoftirqd/221:27:142
25227993225,4cyclictest33-21ksoftirqd/223:08:152
25227993225,4cyclictest33-21ksoftirqd/223:08:142
25227993225,4cyclictest33-21ksoftirqd/221:56:572
25227993225,4cyclictest33-21ksoftirqd/220:57:512
25227993225,4cyclictest33-21ksoftirqd/220:16:522
25227993225,4cyclictest33-21ksoftirqd/220:16:512
2522799314,12cyclictest0-21swapper/222:00:192
25226993124,4cyclictest25-21ksoftirqd/119:17:041
25227993023,4cyclictest33-21ksoftirqd/220:54:392
25227992922,4cyclictest33-21ksoftirqd/223:01:352
123591290,1ptp4l401ktimersoftd/319:14:093
2522799281,12cyclictest21835-21open_inodes22:10:252
25227992619,4cyclictest33-21ksoftirqd/222:05:242
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional