You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 08:03
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot4.osadl.org (updated Sat Jul 27, 2024 00:46:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
95421760,8sleep1501899cyclictest23:35:011
46032145123,10sleep20-21swapper/219:08:232
1299911420,4ptp4l401ktimersoftd/319:07:163
1175721160,7sleep1501899cyclictest20:30:281
5020997937,9cyclictest41-21ksoftirqd/320:20:013
45922784,18sleep10-21swapper/119:08:141
129991780,4ptp4l41-21ksoftirqd/320:40:283
5020997735,8cyclictest41-21ksoftirqd/319:50:313
277302770,6sleep127732-21fschecks_count00:30:131
5020997634,8cyclictest41-21ksoftirqd/322:00:123
5020997534,8cyclictest41-21ksoftirqd/321:15:283
158272750,8sleep0501799cyclictest20:40:190
5020997435,8cyclictest41-21ksoftirqd/300:15:133
5020997335,10cyclictest41-21ksoftirqd/321:05:273
5020997334,8cyclictest41-21ksoftirqd/323:45:113
5020997234,4cyclictest41-21ksoftirqd/319:25:003
5020997232,7cyclictest41-21ksoftirqd/321:30:013
5020997232,10cyclictest41-21ksoftirqd/319:40:283
5020997231,9cyclictest41-21ksoftirqd/322:42:093
5018997264,5cyclictest25-21ksoftirqd/121:05:111
5020997134,8cyclictest41-21ksoftirqd/300:35:003
5018997163,5cyclictest25-21ksoftirqd/121:30:141
5020997056,7cyclictest41-21ksoftirqd/300:00:113
5020997032,7cyclictest41-21ksoftirqd/320:11:063
5020997030,9cyclictest41-21ksoftirqd/323:44:403
5018997062,5cyclictest25-21ksoftirqd/122:15:101
5020996933,4cyclictest41-21ksoftirqd/322:30:223
5020996931,8cyclictest41-21ksoftirqd/319:28:253
5020996930,9cyclictest41-21ksoftirqd/323:10:213
5018996962,4cyclictest25-21ksoftirqd/100:15:091
502099685,8cyclictest41-21ksoftirqd/319:20:003
5020996833,4cyclictest41-21ksoftirqd/323:04:143
5020996831,9cyclictest41-21ksoftirqd/319:55:313
5018996860,5cyclictest25-21ksoftirqd/122:05:131
502099674,9cyclictest41-21ksoftirqd/319:40:003
5020996730,4cyclictest41-21ksoftirqd/300:20:243
5018996761,3cyclictest25-21ksoftirqd/122:10:051
5018996760,4cyclictest25-21ksoftirqd/123:00:041
56498660,40rtkit-daemon18476-21apache219:08:020
5020996634,7cyclictest41-21ksoftirqd/319:30:173
5020996632,8cyclictest41-21ksoftirqd/321:30:193
5020996629,9cyclictest41-21ksoftirqd/322:50:173
5020996629,8cyclictest41-21ksoftirqd/300:38:363
5020996628,9cyclictest41-21ksoftirqd/322:45:193
5020996628,5cyclictest41-21ksoftirqd/323:26:073
5018996659,4cyclictest25-21ksoftirqd/121:55:101
502099656,5cyclictest5259-21tr19:10:143
5020996532,9cyclictest41-21ksoftirqd/320:45:113
502099647,10cyclictest41-21ksoftirqd/300:25:263
502099647,10cyclictest41-21ksoftirqd/300:25:253
5020996428,8cyclictest41-21ksoftirqd/320:52:043
5020996427,8cyclictest41-21ksoftirqd/321:41:103
5018996457,4cyclictest25-21ksoftirqd/119:20:101
5018996456,4cyclictest25-21ksoftirqd/119:55:111
5018996456,4cyclictest25-21ksoftirqd/119:40:121
5018996455,5cyclictest25-21ksoftirqd/121:35:121
5020996328,9cyclictest41-21ksoftirqd/320:35:063
5020996328,9cyclictest41-21ksoftirqd/320:25:263
5018996357,3cyclictest25-21ksoftirqd/123:45:061
502099627,5cyclictest41-21ksoftirqd/322:05:223
502099625,9cyclictest41-21ksoftirqd/322:35:333
5020996229,5cyclictest41-21ksoftirqd/321:35:103
502099622,8cyclictest20279-21awk22:00:013
5018996253,5cyclictest25-21ksoftirqd/120:25:111
502099616,10cyclictest41-21ksoftirqd/323:20:003
5020996145,3cyclictest41-21ksoftirqd/322:25:003
5020996126,10cyclictest41-21ksoftirqd/320:05:283
502099606,7cyclictest41-21ksoftirqd/319:45:163
502099606,4cyclictest41-21ksoftirqd/323:30:323
502099606,10cyclictest41-21ksoftirqd/321:50:123
502099605,4cyclictest41-21ksoftirqd/300:14:593
502099604,9cyclictest41-21ksoftirqd/321:00:013
502099596,10cyclictest41-21ksoftirqd/323:20:313
502099595,4cyclictest41-21ksoftirqd/323:50:223
502099594,5cyclictest41-21ksoftirqd/321:20:183
5020995929,7cyclictest41-21ksoftirqd/322:10:023
502099587,7cyclictest41-21ksoftirqd/321:50:013
502099584,5cyclictest41-21ksoftirqd/322:25:243
502099584,5cyclictest41-21ksoftirqd/320:20:313
5020995825,11cyclictest41-21ksoftirqd/320:30:203
502099580,7cyclictest41-21ksoftirqd/320:05:003
502099572,8cyclictest41-21ksoftirqd/323:55:163
5020995723,10cyclictest41-21ksoftirqd/321:25:403
5018995744,10cyclictest25-21ksoftirqd/121:24:591
5018995730,9cyclictest25-21ksoftirqd/120:15:251
502099567,4cyclictest41-21ksoftirqd/322:55:113
502099561,8cyclictest41-21ksoftirqd/323:35:113
118622560,2sleep111861-21apt22:50:081
79302550,3sleep20-21swapper/219:15:142
502099555,8cyclictest41-21ksoftirqd/322:15:243
502099553,8cyclictest41-21ksoftirqd/321:10:253
502099550,7cyclictest0-21swapper/300:05:143
5019995547,4cyclictest2895-21idleruntime-cro20:15:002
5018995549,3cyclictest25-21ksoftirqd/123:55:001
5020995435,9cyclictest41-21ksoftirqd/323:05:103
5018995347,4cyclictest25-21ksoftirqd/121:00:041
5018995347,4cyclictest25-21ksoftirqd/120:05:001
5018995347,3cyclictest25-21ksoftirqd/121:15:001
5018995346,4cyclictest25-21ksoftirqd/121:00:001
5018995345,4cyclictest25-21ksoftirqd/122:40:001
502099522,5cyclictest41-21ksoftirqd/321:00:203
5018995245,4cyclictest25-21ksoftirqd/119:40:001
5018995245,3cyclictest25-21ksoftirqd/120:40:011
5018995144,4cyclictest25-21ksoftirqd/123:10:001
501899507,7cyclictest25-21ksoftirqd/120:45:011
5018995045,3cyclictest25-21ksoftirqd/119:10:311
5018995044,4cyclictest25-21ksoftirqd/120:10:001
5018995044,3cyclictest25-21ksoftirqd/121:45:001
5018995034,12cyclictest25-21ksoftirqd/121:15:131
5018995016,5cyclictest25-21ksoftirqd/100:20:111
5019994940,5cyclictest15574-21cron21:50:002
5018994943,3cyclictest25-21ksoftirqd/123:45:011
5018994942,4cyclictest7765-21cron20:25:001
5018994942,4cyclictest25-21ksoftirqd/122:50:001
5018994942,4cyclictest25-21ksoftirqd/121:50:131
5018994842,3cyclictest25-21ksoftirqd/123:00:001
5018994842,3cyclictest25-21ksoftirqd/122:35:001
5018994842,3cyclictest25-21ksoftirqd/120:45:221
5018994842,3cyclictest25-21ksoftirqd/100:05:121
5018994842,3cyclictest25-21ksoftirqd/100:00:001
5018994839,6cyclictest25-21ksoftirqd/122:20:241
501899476,7cyclictest25-21ksoftirqd/119:49:591
5018994742,3cyclictest25-21ksoftirqd/120:13:571
5018994742,3cyclictest25-21ksoftirqd/119:35:001
5018994740,4cyclictest25-21ksoftirqd/121:50:011
5018994740,3cyclictest25-21ksoftirqd/123:35:101
5018994735,9cyclictest25-21ksoftirqd/123:10:281
5018994716,7cyclictest25-21ksoftirqd/123:20:311
5017994742,3cyclictest9-21ksoftirqd/000:40:000
5017994740,4cyclictest9-21ksoftirqd/021:10:000
5018994641,3cyclictest25-21ksoftirqd/123:30:001
5018994640,3cyclictest25-21ksoftirqd/119:55:011
5018994639,3cyclictest25-21ksoftirqd/120:55:011
501899461,42cyclictest26999-21cron00:30:011
501899461,42cyclictest26999-21cron00:30:001
5017994640,4cyclictest9-21ksoftirqd/019:40:000
5017994639,4cyclictest9-21ksoftirqd/023:35:000
5019994537,5cyclictest33-21ksoftirqd/220:45:112
5018994540,3cyclictest25-21ksoftirqd/100:10:161
5018994539,4cyclictest25-21ksoftirqd/121:25:291
5018994539,4cyclictest25-21ksoftirqd/121:25:291
5018994539,3cyclictest25-21ksoftirqd/100:00:221
5018994538,4cyclictest25-21ksoftirqd/119:20:001
5018994532,10cyclictest25-21ksoftirqd/119:30:011
5019994438,4cyclictest33-21ksoftirqd/222:07:312
5018994438,3cyclictest25-21ksoftirqd/123:15:121
5017994439,3cyclictest9-21ksoftirqd/023:45:010
5017994438,4cyclictest9-21ksoftirqd/020:30:010
5017994437,4cyclictest15570-21cron21:50:000
5019994329,11cyclictest33-21ksoftirqd/222:37:062
5019994316,4cyclictest20934-21grep19:40:312
501999431,3cyclictest121rcu_preempt23:16:562
5017994336,4cyclictest9-21ksoftirqd/023:00:000
5018994237,3cyclictest25-21ksoftirqd/100:35:091
5018994236,4cyclictest25-21ksoftirqd/122:25:151
5018994236,3cyclictest25-21ksoftirqd/122:05:011
5019994136,3cyclictest33-21ksoftirqd/219:55:222
5019994121,17cyclictest33-21ksoftirqd/220:01:112
5018994135,4cyclictest25-21ksoftirqd/122:40:201
5017994135,3cyclictest9-21ksoftirqd/022:22:110
5017994135,3cyclictest9-21ksoftirqd/019:24:590
5017994134,4cyclictest9-21ksoftirqd/022:00:010
5017994134,4cyclictest9-21ksoftirqd/000:13:050
98122400,8sleep233-21ksoftirqd/221:35:212
5019994034,3cyclictest33-21ksoftirqd/221:03:192
5019994033,4cyclictest33-21ksoftirqd/223:04:362
5019994033,4cyclictest33-21ksoftirqd/220:19:332
501999400,3cyclictest121rcu_preempt00:09:522
5017994034,4cyclictest9-21ksoftirqd/000:00:000
5017994034,3cyclictest9-21ksoftirqd/019:15:090
5017994033,4cyclictest9-21ksoftirqd/023:28:580
5017994033,4cyclictest9-21ksoftirqd/022:36:120
5019993933,4cyclictest33-21ksoftirqd/222:49:312
5019993933,3cyclictest33-21ksoftirqd/223:10:472
5019993932,4cyclictest33-21ksoftirqd/223:45:022
5019993932,4cyclictest33-21ksoftirqd/222:40:342
5017993933,3cyclictest9-21ksoftirqd/022:55:010
5017993932,4cyclictest9-21ksoftirqd/022:16:260
5017993932,4cyclictest9-21ksoftirqd/019:52:130
501999384,9cyclictest11863-21apt-get22:50:092
501999383,6cyclictest0-21swapper/220:30:112
5019993833,3cyclictest33-21ksoftirqd/221:25:302
5019993833,3cyclictest33-21ksoftirqd/221:25:292
5019993832,3cyclictest33-21ksoftirqd/223:27:292
5019993832,3cyclictest33-21ksoftirqd/221:51:422
5019993832,3cyclictest33-21ksoftirqd/200:39:402
5019993831,4cyclictest33-21ksoftirqd/221:43:202
5019993831,4cyclictest33-21ksoftirqd/221:33:172
5019993831,4cyclictest33-21ksoftirqd/221:06:432
5019993831,4cyclictest33-21ksoftirqd/220:24:512
5019993831,4cyclictest33-21ksoftirqd/219:22:452
5019993830,5cyclictest33-21ksoftirqd/222:32:552
5019993814,4cyclictest22381-21/usr/sbin/munin00:20:242
5019993812,4cyclictest19180-21ls00:10:322
5019993810,5cyclictest16192-21unixbench_multi19:30:292
5017993833,3cyclictest9-21ksoftirqd/020:55:310
5017993832,3cyclictest9-21ksoftirqd/022:07:580
5017993832,3cyclictest9-21ksoftirqd/021:33:240
5017993832,3cyclictest9-21ksoftirqd/021:12:410
5017993831,4cyclictest9-21ksoftirqd/023:24:200
5017993831,4cyclictest9-21ksoftirqd/022:41:040
5017993831,4cyclictest9-21ksoftirqd/020:31:470
5017993831,4cyclictest9-21ksoftirqd/000:00:370
501999373,7cyclictest0-21swapper/220:50:102
5019993732,3cyclictest33-21ksoftirqd/219:14:012
5019993730,4cyclictest33-21ksoftirqd/200:02:562
5019993729,5cyclictest33-21ksoftirqd/222:16:052
501999372,6cyclictest0-21swapper/200:25:102
501999372,6cyclictest0-21swapper/200:25:102
5017993731,3cyclictest9-21ksoftirqd/020:37:400
5017993730,4cyclictest9-21ksoftirqd/023:48:490
5017993730,4cyclictest9-21ksoftirqd/021:54:220
5017993730,4cyclictest9-21ksoftirqd/021:02:390
5017993730,4cyclictest9-21ksoftirqd/020:06:420
5017993730,4cyclictest9-21ksoftirqd/019:57:590
5019993630,3cyclictest33-21ksoftirqd/223:07:252
5019993630,3cyclictest33-21ksoftirqd/220:56:412
5019993629,4cyclictest33-21ksoftirqd/223:22:332
5019993629,4cyclictest33-21ksoftirqd/219:45:592
5019993629,4cyclictest33-21ksoftirqd/219:37:292
501999362,8cyclictest15255-21apt-get20:40:112
5017993630,3cyclictest9-21ksoftirqd/022:02:560
5017993630,3cyclictest9-21ksoftirqd/021:30:000
5017993630,3cyclictest9-21ksoftirqd/021:30:000
5017993630,3cyclictest9-21ksoftirqd/021:20:000
5017993630,3cyclictest9-21ksoftirqd/000:32:130
5017993629,4cyclictest9-21ksoftirqd/023:19:540
5017993629,4cyclictest9-21ksoftirqd/021:38:120
5017993629,4cyclictest9-21ksoftirqd/020:54:200
5017993629,4cyclictest9-21ksoftirqd/020:48:170
5017993629,4cyclictest9-21ksoftirqd/020:01:130
5019993530,3cyclictest33-21ksoftirqd/221:55:262
5019993528,4cyclictest33-21ksoftirqd/222:22:022
5019993528,4cyclictest33-21ksoftirqd/221:11:202
5019993528,4cyclictest33-21ksoftirqd/200:19:182
5019993511,4cyclictest3022-21open_inodes21:20:222
5017993530,3cyclictest9-21ksoftirqd/019:25:300
5017993529,3cyclictest9-21ksoftirqd/022:35:000
5017993529,3cyclictest9-21ksoftirqd/020:18:290
5017993528,4cyclictest9-21ksoftirqd/023:05:100
5017993528,4cyclictest9-21ksoftirqd/021:40:090
5017993528,4cyclictest9-21ksoftirqd/019:40:130
5017993528,4cyclictest9-21ksoftirqd/000:17:320
501999349,4cyclictest31851-21irqrtprio23:30:212
5019993427,4cyclictest33-21ksoftirqd/222:28:492
5019993427,4cyclictest33-21ksoftirqd/200:31:162
5019993412,4cyclictest11724-21phc2sys23:55:272
5017993429,3cyclictest9-21ksoftirqd/019:31:300
5017993428,3cyclictest9-21ksoftirqd/020:23:480
5017993427,4cyclictest9-21ksoftirqd/023:54:550
5017993427,4cyclictest9-21ksoftirqd/021:23:380
5017993427,4cyclictest9-21ksoftirqd/000:23:460
5019993327,3cyclictest33-21ksoftirqd/223:37:122
5019993327,3cyclictest33-21ksoftirqd/219:28:362
5019993326,4cyclictest33-21ksoftirqd/223:54:492
5019993326,4cyclictest33-21ksoftirqd/223:41:092
5019993326,4cyclictest33-21ksoftirqd/222:11:072
5019993326,4cyclictest33-21ksoftirqd/222:01:192
5019993326,4cyclictest33-21ksoftirqd/221:15:372
5017993327,4cyclictest9-21ksoftirqd/000:06:000
5017993327,3cyclictest9-21ksoftirqd/023:36:150
501799331,5cyclictest0-21swapper/022:10:190
5019993225,4cyclictest33-21ksoftirqd/219:53:192
5017993226,3cyclictest9-21ksoftirqd/022:28:260
5017993226,3cyclictest9-21ksoftirqd/020:11:330
5017993226,3cyclictest9-21ksoftirqd/000:29:450
5017993226,3cyclictest9-21ksoftirqd/000:29:440
5017993225,4cyclictest9-21ksoftirqd/023:15:000
5019993124,4cyclictest33-21ksoftirqd/220:37:192
5017993119,5cyclictest0-21swapper/019:45:090
5017993025,3cyclictest9-21ksoftirqd/019:10:300
5017992924,3cyclictest9-21ksoftirqd/023:00:330
5017992821,4cyclictest9-21ksoftirqd/022:47:050
5019992720,4cyclictest33-21ksoftirqd/220:29:292
5019992419,3cyclictest33-21ksoftirqd/222:55:122
5019992318,3cyclictest33-21ksoftirqd/220:07:562
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional