You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-28 - 20:41
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackdslot2.osadl.org (updated Sun Apr 28, 2024 12:46:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1564221650,8sleep141799cyclictest07:45:151
123591990,4ptp4l401ktimersoftd/307:09:093
57698940,9rtkit-daemon0-21swapper/207:07:502
418998982,4cyclictest33-21ksoftirqd/207:15:102
418998880,5cyclictest33-21ksoftirqd/210:15:122
418998879,5cyclictest33-21ksoftirqd/208:20:132
322982889,18sleep00-21swapper/007:06:150
418998780,4cyclictest33-21ksoftirqd/212:25:132
418998779,5cyclictest33-21ksoftirqd/209:20:112
418998749,11cyclictest33-21ksoftirqd/212:20:002
418998679,4cyclictest33-21ksoftirqd/207:45:152
418998678,4cyclictest33-21ksoftirqd/211:15:132
418998577,5cyclictest33-21ksoftirqd/208:55:152
418998477,4cyclictest33-21ksoftirqd/208:10:122
418998475,5cyclictest33-21ksoftirqd/209:35:142
418998475,5cyclictest33-21ksoftirqd/209:35:132
418998375,5cyclictest33-21ksoftirqd/209:40:142
418998375,4cyclictest33-21ksoftirqd/211:05:132
418998375,4cyclictest33-21ksoftirqd/211:05:132
418998073,4cyclictest33-21ksoftirqd/211:00:052
418998053,4cyclictest33-21ksoftirqd/212:35:162
418997769,5cyclictest33-21ksoftirqd/210:40:152
418997668,5cyclictest33-21ksoftirqd/210:20:132
418997638,5cyclictest33-21ksoftirqd/207:25:162
418997441,4cyclictest33-21ksoftirqd/210:00:322
418997341,4cyclictest33-21ksoftirqd/210:10:212
418997239,4cyclictest33-21ksoftirqd/210:45:202
418997229,9cyclictest33-21ksoftirqd/207:50:142
418997161,5cyclictest33-21ksoftirqd/207:40:042
418997139,8cyclictest33-21ksoftirqd/211:20:222
418997137,5cyclictest33-21ksoftirqd/211:45:182
418997129,9cyclictest33-21ksoftirqd/207:30:312
418997062,4cyclictest33-21ksoftirqd/211:55:042
418997041,7cyclictest33-21ksoftirqd/210:50:252
418996938,4cyclictest33-21ksoftirqd/211:25:162
418996937,7cyclictest33-21ksoftirqd/211:40:162
418996937,4cyclictest33-21ksoftirqd/212:00:262
418996836,4cyclictest33-21ksoftirqd/208:45:202
418996827,7cyclictest33-21ksoftirqd/209:15:352
418996759,4cyclictest33-21ksoftirqd/209:30:052
418996735,4cyclictest33-21ksoftirqd/211:30:212
418996733,4cyclictest33-21ksoftirqd/209:45:362
418996727,7cyclictest33-21ksoftirqd/211:35:172
418996726,11cyclictest33-21ksoftirqd/209:05:322
418996653,4cyclictest33-21ksoftirqd/209:25:152
418996632,4cyclictest33-21ksoftirqd/208:09:112
418996622,10cyclictest33-21ksoftirqd/209:00:132
41899658,8cyclictest33-21ksoftirqd/212:06:032
418996532,4cyclictest33-21ksoftirqd/208:50:182
147172650,5sleep114720-21unixbench_singl07:40:341
418996435,7cyclictest33-21ksoftirqd/210:25:142
418996434,4cyclictest33-21ksoftirqd/207:10:212
418996332,7cyclictest33-21ksoftirqd/212:20:292
418996328,5cyclictest33-21ksoftirqd/211:00:002
418996323,7cyclictest33-21ksoftirqd/209:10:152
418996247,12cyclictest33-21ksoftirqd/212:15:002
418996155,3cyclictest33-21ksoftirqd/208:20:012
418996155,3cyclictest33-21ksoftirqd/208:20:002
418996155,3cyclictest33-21ksoftirqd/208:00:002
418996153,4cyclictest33-21ksoftirqd/207:40:012
418996151,3cyclictest33-21ksoftirqd/212:30:382
418996151,3cyclictest33-21ksoftirqd/212:30:382
123591610,2ptp4l401ktimersoftd/311:18:283
123591610,1ptp4l401ktimersoftd/307:25:143
418996029,7cyclictest33-21ksoftirqd/211:50:172
123591600,1ptp4l401ktimersoftd/307:47:363
418995951,4cyclictest33-21ksoftirqd/210:00:002
418995948,4cyclictest33-21ksoftirqd/210:35:332
418995946,4cyclictest33-21ksoftirqd/208:30:272
418995925,4cyclictest33-21ksoftirqd/208:35:282
123591590,1ptp4l401ktimersoftd/310:51:593
418995853,3cyclictest33-21ksoftirqd/210:05:272
418995827,18cyclictest33-21ksoftirqd/210:30:292
418995744,11cyclictest33-21ksoftirqd/211:10:192
418995718,8cyclictest33-21ksoftirqd/208:00:242
418995650,4cyclictest33-21ksoftirqd/209:50:132
418995650,3cyclictest33-21ksoftirqd/208:45:012
418995346,4cyclictest33-21ksoftirqd/208:30:012
418995346,4cyclictest33-21ksoftirqd/207:25:002
417995231,18cyclictest25-21ksoftirqd/108:28:111
419994942,4cyclictest41-21ksoftirqd/310:40:003
417994826,18cyclictest25-21ksoftirqd/109:42:261
417994726,18cyclictest25-21ksoftirqd/110:44:571
416994730,14cyclictest9-21ksoftirqd/009:15:070
419994641,3cyclictest41-21ksoftirqd/311:40:003
419994640,3cyclictest41-21ksoftirqd/311:59:593
419994639,4cyclictest41-21ksoftirqd/310:10:013
419994639,4cyclictest41-21ksoftirqd/309:45:013
417994625,18cyclictest25-21ksoftirqd/108:20:561
416994631,12cyclictest9-21ksoftirqd/010:28:410
416994538,4cyclictest9-21ksoftirqd/010:39:590
3228224514,18sleep10-21swapper/107:06:041
123591450,1ptp4l401ktimersoftd/308:15:313
123591450,1ptp4l401ktimersoftd/308:15:303
123591450,1ptp4l401ktimersoftd/307:50:363
41799440,6cyclictest15459-21tune2fs11:15:181
416994428,13cyclictest9-21ksoftirqd/011:47:190
123591440,1ptp4l401ktimersoftd/312:15:143
123591440,1ptp4l401ktimersoftd/310:45:253
123591440,1ptp4l401ktimersoftd/307:17:323
419994338,3cyclictest41-21ksoftirqd/309:10:103
419994337,4cyclictest41-21ksoftirqd/309:56:023
419994336,4cyclictest41-21ksoftirqd/311:00:003
419994336,4cyclictest41-21ksoftirqd/309:05:593
417994337,3cyclictest25-21ksoftirqd/111:45:101
41799430,5cyclictest11121-21expr12:15:141
123591430,1ptp4l401ktimersoftd/312:05:133
419994235,4cyclictest41-21ksoftirqd/309:30:003
417994235,4cyclictest25-21ksoftirqd/109:08:511
417994234,5cyclictest25-21ksoftirqd/110:58:101
417994221,18cyclictest25-21ksoftirqd/111:57:441
416994235,4cyclictest9-21ksoftirqd/009:14:090
416994226,13cyclictest9-21ksoftirqd/007:37:070
41699420,4cyclictest29971-21irqrtprio08:15:230
41699420,4cyclictest29971-21irqrtprio08:15:220
419994135,4cyclictest41-21ksoftirqd/310:10:023
419994135,3cyclictest41-21ksoftirqd/311:44:253
419994134,4cyclictest41-21ksoftirqd/307:55:513
419994134,4cyclictest15304-21sh12:25:003
417994134,4cyclictest25-21ksoftirqd/110:20:101
41799412,34cyclictest0-21swapper/110:10:081
41799411,4cyclictest0-21swapper/112:05:121
417994112,25cyclictest8272-21ls07:30:101
419994035,3cyclictest41-21ksoftirqd/312:40:013
419994035,3cyclictest41-21ksoftirqd/312:13:063
419994034,3cyclictest41-21ksoftirqd/311:12:573
419994034,3cyclictest41-21ksoftirqd/308:10:003
419994033,4cyclictest41-21ksoftirqd/308:40:003
419994033,4cyclictest41-21ksoftirqd/308:32:473
417994033,4cyclictest25-21ksoftirqd/108:11:401
41799402,9cyclictest21943-21apt-get11:30:131
41799402,4cyclictest0-21swapper/110:50:121
417994014,23cyclictest11792-21find07:35:331
417994012,25cyclictest4004-21phc2sys07:15:261
417994012,24cyclictest19907-21cat11:25:141
417994012,24cyclictest14849-21expr10:05:151
417994011,25cyclictest20215-21expr07:55:151
416994034,3cyclictest9-21ksoftirqd/011:58:010
416994033,4cyclictest9-21ksoftirqd/011:09:330
416994033,4cyclictest9-21ksoftirqd/011:09:320
416994013,23cyclictest30599-21seq10:40:140
78902390,3sleep10-21swapper/109:50:181
419993934,3cyclictest41-21ksoftirqd/311:25:183
419993934,3cyclictest41-21ksoftirqd/307:34:513
419993933,3cyclictest41-21ksoftirqd/310:23:523
419993932,4cyclictest41-21ksoftirqd/309:34:063
419993932,4cyclictest41-21ksoftirqd/309:00:123
419993931,5cyclictest41-21ksoftirqd/308:29:503
417993932,4cyclictest25-21ksoftirqd/110:34:081
417993932,4cyclictest25-21ksoftirqd/109:00:041
417993932,4cyclictest25-21ksoftirqd/108:02:261
41799392,5cyclictest0-21swapper/111:39:301
41799391,34cyclictest31376-21cpuspeed_turbos11:50:121
417993912,24cyclictest7924-21basename11:00:101
417993912,23cyclictest20853-21ls09:10:101
417993911,25cyclictest22460-21latency_hist12:40:011
417993911,24cyclictest8262-21ls08:40:271
417993911,24cyclictest28594-21kernelversion09:25:251
417993911,24cyclictest18547-21cat12:30:311
417993911,24cyclictest18547-21cat12:30:301
417993911,24cyclictest12631-21cat11:10:111
417993911,24cyclictest10611-21kernelversion09:55:191
417993910,25cyclictest9060-21irqrtprio12:10:201
417993910,25cyclictest13474-21grep12:20:131
416993933,3cyclictest9-21ksoftirqd/010:16:360
416993933,3cyclictest9-21ksoftirqd/008:35:210
416993932,4cyclictest9-21ksoftirqd/012:01:200
416993932,4cyclictest9-21ksoftirqd/010:57:570
416993932,4cyclictest9-21ksoftirqd/009:02:190
416993931,5cyclictest9-21ksoftirqd/008:22:250
416993922,5cyclictest9-21ksoftirqd/011:51:560
416993913,23cyclictest21352-21expr12:35:240
416993912,24cyclictest20880-21readlink11:25:270
416993912,23cyclictest6802-21cat08:40:090
41699390,4cyclictest19628-21taskset12:31:150
41699390,4cyclictest19628-21taskset12:31:140
419993832,4cyclictest41-21ksoftirqd/311:30:103
419993832,4cyclictest41-21ksoftirqd/308:00:323
419993832,3cyclictest41-21ksoftirqd/311:02:423
419993832,3cyclictest41-21ksoftirqd/310:43:323
419993831,4cyclictest41-21ksoftirqd/311:45:053
419993831,4cyclictest41-21ksoftirqd/308:55:153
419993831,4cyclictest41-21ksoftirqd/308:53:493
419993831,4cyclictest41-21ksoftirqd/307:41:293
419993830,5cyclictest41-21ksoftirqd/309:47:013
41799383,8cyclictest17320-21apt-get11:20:101
417993831,4cyclictest25-21ksoftirqd/108:34:241
417993830,5cyclictest25-21ksoftirqd/109:37:171
417993830,5cyclictest25-21ksoftirqd/109:37:171
417993830,4cyclictest26681-21sh08:10:001
41799382,32cyclictest30472-21latency_hist10:40:011
417993812,22cyclictest10941-21if_enp1s011:05:221
417993812,22cyclictest10941-21if_enp1s011:05:211
417993811,23cyclictest24055-21df_abs10:25:151
417993811,23cyclictest15854-21latency_hist09:00:011
417993810,24cyclictest29975-21irqrtprio08:15:231
417993810,24cyclictest29975-21irqrtprio08:15:231
417993810,24cyclictest16287-21irqrtprio12:25:231
416993833,3cyclictest9-21ksoftirqd/009:52:410
416993832,4cyclictest9-21ksoftirqd/008:34:240
416993832,3cyclictest9-21ksoftirqd/012:18:530
416993832,3cyclictest9-21ksoftirqd/010:20:100
416993831,4cyclictest9-21ksoftirqd/009:33:020
416993830,5cyclictest9-21ksoftirqd/009:46:540
416993830,5cyclictest9-21ksoftirqd/009:40:050
416993813,22cyclictest8974-21cat12:10:170
416993813,22cyclictest16814-21seq11:17:520
416993812,23cyclictest28062-21df_abs09:25:170
41699380,5cyclictest25262-21snmpd10:49:100
123591380,1ptp4l401ktimersoftd/310:16:323
419993731,3cyclictest41-21ksoftirqd/309:38:053
419993731,3cyclictest41-21ksoftirqd/309:38:043
419993730,4cyclictest41-21ksoftirqd/312:31:063
419993730,4cyclictest41-21ksoftirqd/312:31:053
419993730,4cyclictest41-21ksoftirqd/311:53:593
419993730,4cyclictest41-21ksoftirqd/309:17:593
419993730,4cyclictest41-21ksoftirqd/308:14:183
41799379,25cyclictest7811-21sshd07:29:101
417993731,3cyclictest25-21ksoftirqd/109:33:471
417993729,5cyclictest25-21ksoftirqd/108:35:381
41799372,6cyclictest9168-21apt-get08:45:131
417993718,16cyclictest25-21ksoftirqd/110:02:131
417993711,23cyclictest19192-21expr07:50:311
416993732,3cyclictest9-21ksoftirqd/011:02:210
416993731,3cyclictest9-21ksoftirqd/008:56:510
416993730,4cyclictest9-21ksoftirqd/012:26:290
416993730,4cyclictest9-21ksoftirqd/010:10:410
416993730,4cyclictest9-21ksoftirqd/008:51:270
416993730,4cyclictest9-21ksoftirqd/007:11:550
41699372,5cyclictest0-21swapper/011:35:140
416993712,22cyclictest18539-21sed11:20:280
416993711,23cyclictest9927-21sshd07:31:010
419993631,3cyclictest41-21ksoftirqd/311:23:343
419993631,3cyclictest41-21ksoftirqd/307:15:003
419993630,4cyclictest41-21ksoftirqd/308:24:373
419993630,3cyclictest41-21ksoftirqd/312:04:423
419993630,3cyclictest41-21ksoftirqd/310:31:523
419993629,4cyclictest41-21ksoftirqd/308:48:173
41799369,23cyclictest26918-21df_abs11:40:151
417993630,3cyclictest25-21ksoftirqd/108:53:481
417993629,4cyclictest25-21ksoftirqd/109:17:251
417993629,4cyclictest25-21ksoftirqd/107:20:031
41799362,8cyclictest3760-21apt-get12:00:111
417993611,23cyclictest829-21df07:10:161
41699368,4cyclictest24466-21latency_hist08:04:590
416993630,4cyclictest9-21ksoftirqd/009:09:550
416993630,3cyclictest9-21ksoftirqd/010:00:110
416993629,4cyclictest9-21ksoftirqd/009:36:020
416993629,4cyclictest9-21ksoftirqd/009:36:010
416993629,4cyclictest9-21ksoftirqd/009:22:140
41699362,7cyclictest6073-21apt-get12:05:120
416993612,21cyclictest27568-21if_enp1s008:10:200
416993610,22cyclictest13048-21sed11:10:150
419993530,3cyclictest41-21ksoftirqd/312:25:263
419993529,4cyclictest41-21ksoftirqd/308:40:263
419993528,4cyclictest41-21ksoftirqd/310:26:493
419993528,4cyclictest41-21ksoftirqd/309:54:523
419993528,4cyclictest41-21ksoftirqd/309:20:563
417993528,4cyclictest25-21ksoftirqd/109:21:221
417993513,19cyclictest6297-21ptp4l09:45:301
416993528,4cyclictest9-21ksoftirqd/007:18:000
416993512,20cyclictest5957-21cpuspeed07:25:090
416993510,22cyclictest3064-21/usr/sbin/munin10:50:290
419993429,3cyclictest41-21ksoftirqd/307:35:343
419993428,3cyclictest41-21ksoftirqd/310:01:163
417993426,5cyclictest25-21ksoftirqd/110:45:101
41699348,3cyclictest17908-21grep07:50:130
41699347,5cyclictest16425-21uname07:45:280
41699347,4cyclictest10706-21timerwakeupswit08:45:340
416993427,4cyclictest9-21ksoftirqd/009:55:090
41699342,5cyclictest0-21swapper/011:30:130
416993410,21cyclictest14048-21missed_timers07:40:260
41699340,12cyclictest27011-21needreboot10:30:250
123591340,1ptp4l401ktimersoftd/307:21:093
417993326,4cyclictest25-21ksoftirqd/110:16:351
416993327,4cyclictest9-21ksoftirqd/010:06:300
416993327,3cyclictest9-21ksoftirqd/011:44:200
41699331,6cyclictest21626-21sed07:55:370
41699331,6cyclictest1971-21grep08:30:000
41699330,7cyclictest25353-21grep08:05:200
41699330,6cyclictest13440-21tr12:20:130
416993125,4cyclictest9-21ksoftirqd/007:21:260
419992923,3cyclictest41-21ksoftirqd/311:05:563
419992923,3cyclictest41-21ksoftirqd/311:05:553
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional