You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-09-25 - 12:48
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5.osadl.org (updated Mon Sep 25, 2023 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
865993227,4cyclictest28907-21ssh23:29:462
86599320,31cyclictest18572-21ssh00:25:542
86599320,31cyclictest0-21swapper/223:15:492
86599320,29cyclictest28290-21rm21:13:042
86599320,29cyclictest24620-21diskmemload00:08:182
86599320,0cyclictest0-21swapper/222:41:012
86999310,30cyclictest29856-21taskset22:21:503
865993128,3cyclictest24620-21diskmemload22:46:172
865993127,3cyclictest23380-21ssh00:31:102
86599310,30cyclictest568-21systemd-logind00:00:012
86599310,28cyclictest0-21swapper/222:55:522
86599310,0cyclictest0-21swapper/221:50:102
86599310,0cyclictest0-21swapper/221:28:422
864993130,1cyclictest561-21dbus-daemon19:50:001
86499310,30cyclictest561-21dbus-daemon00:00:011
863993129,1cyclictest11846-21/usr/sbin/munin00:20:330
863993128,2cyclictest0-21swapper/021:34:380
86399312,1cyclictest58550irq/126-eno122:51:260
86399310,30cyclictest19401-21cron19:50:000
86399310,30cyclictest18987-21expr22:45:210
86399310,2cyclictest12541-21ssh22:38:210
869993029,1cyclictest28627-21ssh00:03:033
869993028,2cyclictest2724-21cron21:55:013
869993028,1cyclictest24620-21diskmemload23:05:273
869993028,1cyclictest0-21swapper/322:29:153
86999300,29cyclictest8044-21runrttasks22:00:013
86999300,29cyclictest24620-21diskmemload23:15:133
86999300,29cyclictest24620-21diskmemload22:47:413
86999300,29cyclictest24620-21diskmemload22:32:103
86999300,29cyclictest24620-21diskmemload22:05:273
86999300,29cyclictest24620-21diskmemload21:40:383
86999300,29cyclictest24620-21diskmemload21:25:383
86999300,29cyclictest24620-21diskmemload00:15:293
86999300,29cyclictest17522-21ssh21:35:253
86999300,29cyclictest0-21swapper/323:20:363
86999300,29cyclictest0-21swapper/323:10:023
86999300,29cyclictest0-21swapper/321:30:123
86999300,29cyclictest0-21swapper/321:17:323
86999300,29cyclictest0-21swapper/321:14:413
86999300,29cyclictest0-21swapper/319:20:023
86999300,29cyclictest0-21swapper/319:20:013
86999300,29cyclictest0-21swapper/300:35:373
86999300,1cyclictest24620-21diskmemload23:25:153
86999300,1cyclictest17584-21awk20:55:013
86999300,1cyclictest0-21swapper/320:35:013
865993028,2cyclictest24620-21diskmemload23:31:002
865993028,2cyclictest24620-21diskmemload00:23:422
865993028,2cyclictest0-21swapper/222:15:212
86599300,30cyclictest0-21swapper/223:42:062
86599300,29cyclictest5654-21ssh00:13:062
86599300,29cyclictest29371-21apt-get20:10:202
86599300,29cyclictest28229-21ssh00:36:192
86599300,29cyclictest24620-21diskmemload23:20:022
86599300,29cyclictest24620-21diskmemload21:55:212
86599300,29cyclictest17200-21mailstats23:50:292
86599300,29cyclictest16735-21ssh22:09:012
864993029,1cyclictest24620-21diskmemload22:41:241
864993028,1cyclictest24620-21diskmemload00:10:321
86499300,29cyclictest24620-21diskmemload00:20:241
86499300,29cyclictest24184-21ssh23:24:471
86499300,29cyclictest10358-21ssh22:01:091
86499300,29cyclictest0-21swapper/122:09:051
86499300,29cyclictest0-21swapper/120:00:021
86499300,1cyclictest24620-21diskmemload23:11:131
86499300,1cyclictest18007-21sshd00:25:301
863993030,0cyclictest58550irq/126-eno122:21:100
863993028,2cyclictest0-21swapper/021:51:540
863993028,1cyclictest754-21runrttasks22:28:070
863993028,1cyclictest0-21swapper/023:36:420
86399300,29cyclictest2571-21apt-get00:10:330
86399300,29cyclictest24620-21diskmemload21:40:540
86399300,29cyclictest24620-21diskmemload00:31:080
86399300,29cyclictest0-21swapper/023:55:320
86399300,29cyclictest0-21swapper/023:00:280
86399300,29cyclictest0-21swapper/022:10:470
86399300,29cyclictest0-21swapper/021:56:320
86399300,29cyclictest0-21swapper/021:36:220
86399300,1cyclictest24620-21diskmemload23:21:150
86399300,1cyclictest11156-21apt-get23:45:190
869992928,1cyclictest24620-21diskmemload00:31:023
869992928,0cyclictest24620-21diskmemload00:20:253
86999290,29cyclictest0-21swapper/323:50:493
86999290,29cyclictest0-21swapper/323:35:403
86999290,29cyclictest0-21swapper/323:02:043
86999290,29cyclictest0-21swapper/322:40:463
86999290,29cyclictest0-21swapper/322:16:443
86999290,29cyclictest0-21swapper/322:10:143
86999290,29cyclictest0-21swapper/321:55:303
86999290,29cyclictest0-21swapper/321:20:033
86999290,28cyclictest0-21swapper/323:55:173
86999290,1cyclictest18753-21ssh00:26:143
86999290,1cyclictest0-21swapper/323:30:253
86999290,1cyclictest0-21swapper/322:36:283
86999290,1cyclictest0-21swapper/321:45:563
86999290,1cyclictest0-21swapper/300:13:133
86999290,0cyclictest24620-21diskmemload23:42:593
86999290,0cyclictest0-21swapper/323:46:393
86999290,0cyclictest0-21swapper/322:51:133
86999290,0cyclictest0-21swapper/300:05:053
865992929,0cyclictest24620-21diskmemload00:00:262
865992927,1cyclictest0-21swapper/222:35:262
865992927,1cyclictest0-21swapper/222:00:262
86599290,29cyclictest13365-21ssh23:12:422
86599290,29cyclictest12692-21/usr/sbin/munin21:30:272
86599290,29cyclictest0-21swapper/223:45:412
86599290,29cyclictest0-21swapper/223:35:592
86599290,29cyclictest0-21swapper/223:00:332
86599290,29cyclictest0-21swapper/222:50:142
86599290,29cyclictest0-21swapper/222:30:172
86599290,29cyclictest0-21swapper/222:27:322
86599290,29cyclictest0-21swapper/222:21:252
86599290,28cyclictest29835-21apt-get21:15:182
86599290,1cyclictest19847-21ssh22:11:072
86599290,0cyclictest24620-21diskmemload21:20:462
86599290,0cyclictest0-21swapper/221:45:272
86599290,0cyclictest0-21swapper/221:36:182
86599290,0cyclictest0-21swapper/220:05:192
86599290,0cyclictest0-21swapper/219:10:152
864992929,0cyclictest24620-21diskmemload23:50:161
864992929,0cyclictest0-21swapper/121:50:191
86499290,29cyclictest7173-21ssh23:05:401
86499290,29cyclictest24620-21diskmemload23:32:451
86499290,29cyclictest24620-21diskmemload23:26:011
86499290,29cyclictest0-21swapper/123:45:191
86499290,29cyclictest0-21swapper/123:15:201
86499290,29cyclictest0-21swapper/123:00:111
86499290,29cyclictest0-21swapper/122:55:451
86499290,29cyclictest0-21swapper/122:52:571
86499290,29cyclictest0-21swapper/122:46:181
86499290,29cyclictest0-21swapper/122:36:441
86499290,29cyclictest0-21swapper/122:31:561
86499290,29cyclictest0-21swapper/122:28:301
86499290,29cyclictest0-21swapper/122:21:131
86499290,29cyclictest0-21swapper/122:15:441
86499290,29cyclictest0-21swapper/122:10:471
86499290,29cyclictest0-21swapper/121:45:311
86499290,29cyclictest0-21swapper/121:40:071
86499290,29cyclictest0-21swapper/121:30:141
86499290,29cyclictest0-21swapper/121:29:581
86499290,29cyclictest0-21swapper/121:10:331
86499290,28cyclictest31990-21sh21:16:121
86499290,0cyclictest0-21swapper/123:38:321
86499290,0cyclictest0-21swapper/121:55:251
86499290,0cyclictest0-21swapper/121:39:241
86499290,0cyclictest0-21swapper/121:20:211
86499290,0cyclictest0-21swapper/100:35:311
86499290,0cyclictest0-21swapper/100:30:481
86499290,0cyclictest0-21swapper/100:19:531
86499290,0cyclictest0-21swapper/100:05:401
86499290,0cyclictest0-21swapper/100:00:341
863992928,1cyclictest27075-21ssh23:26:320
863992928,1cyclictest27062-21ssh00:35:280
863992928,1cyclictest10370-21apt-get23:10:180
863992927,1cyclictest0-21swapper/021:15:110
86399290,29cyclictest58550irq/126-eno123:41:280
86399290,29cyclictest24620-21diskmemload22:40:140
86399290,29cyclictest24620-21diskmemload21:46:580
86399290,29cyclictest24620-21diskmemload21:20:040
86399290,29cyclictest24620-21diskmemload00:27:050
86399290,29cyclictest24620-21diskmemload00:06:480
86399290,29cyclictest0-21swapper/023:50:020
86399290,29cyclictest0-21swapper/023:07:090
86399290,29cyclictest0-21swapper/022:55:580
86399290,29cyclictest0-21swapper/022:15:350
86399290,1cyclictest7141-21ssh00:15:190
86399290,1cyclictest12839-21ssh22:05:030
86399290,1cyclictest0-21swapper/000:00:350
86399290,0cyclictest24620-21diskmemload22:00:090
86399290,0cyclictest24620-21diskmemload21:25:530
86399290,0cyclictest24620-21diskmemload21:10:180
86399290,0cyclictest0-21swapper/023:34:550
86399290,0cyclictest0-21swapper/023:15:200
86399290,0cyclictest0-21swapper/022:30:150
869992828,0cyclictest24144-21apt-get20:00:023
86999280,28cyclictest0-21swapper/320:25:193
865992828,0cyclictest24635-21perf21:10:002
86499280,0cyclictest0-21swapper/123:40:251
863992828,0cyclictest0-21swapper/020:00:020
863992828,0cyclictest0-21swapper/019:30:180
863992828,0cyclictest0-21swapper/019:25:200
864992727,0cyclictest0-21swapper/120:20:201
864992727,0cyclictest0-21swapper/119:35:201
864992726,1cyclictest8097-21apt-get19:25:191
869992626,0cyclictest10412-21apt-get19:30:183
869992626,0cyclictest0-21swapper/320:15:193
869992626,0cyclictest0-21swapper/319:50:193
864992626,0cyclictest0-21swapper/119:30:181
863992626,0cyclictest0-21swapper/020:20:200
863992626,0cyclictest0-21swapper/019:20:210
865992525,0cyclictest0-21swapper/219:20:192
864992525,0cyclictest5776-21apt-get19:20:201
863992525,0cyclictest0-21swapper/020:25:190
863992525,0cyclictest0-21swapper/019:50:190
863992525,0cyclictest0-21swapper/019:15:180
863992525,0cyclictest0-21swapper/019:15:180
869992424,0cyclictest0-21swapper/319:25:193
864992423,1cyclictest19708-21apt-get19:50:191
869992323,0cyclictest17875-21apt-get20:55:193
869992322,1cyclictest1620-21apt-get20:20:203
865992323,0cyclictest0-21swapper/220:35:192
864992323,0cyclictest0-21swapper/120:25:201
864992323,0cyclictest0-21swapper/119:15:181
864992323,0cyclictest0-21swapper/119:15:181
869992222,0cyclictest0-21swapper/320:40:213
865992121,0cyclictest6259-21apt-get20:30:202
865992119,1cyclictest22295-21cron21:05:002
869992020,0cyclictest0-21swapper/319:55:173
863992020,0cyclictest0-21swapper/020:50:210
865991919,0cyclictest0-21swapper/219:45:192
863991919,0cyclictest0-21swapper/021:00:180
869991818,0cyclictest0-21swapper/319:40:243
865991817,1cyclictest10113-21cron19:30:012
864991818,0cyclictest15561-21apt-get20:50:211
863991818,0cyclictest0-21swapper/020:15:200
864991717,0cyclictest20215-21apt-get21:00:181
865991613,2cyclictest20905-21pmu-power19:50:282
86599160,15cyclictest3956-21perl19:15:212
86599160,15cyclictest3956-21perl19:15:212
864991616,0cyclictest0-21swapper/120:15:191
86499160,15cyclictest10145-21sed20:35:291
863991616,0cyclictest0-21swapper/020:45:190
863991614,1cyclictest0-21swapper/020:35:240
869991515,0cyclictest0-21swapper/320:05:293
869991514,0cyclictest0-21swapper/320:10:303
86599150,1cyclictest0-21swapper/220:50:322
864991515,0cyclictest13240-21apt-get20:45:191
863991515,0cyclictest0-21swapper/020:55:180
869991412,1cyclictest0-21swapper/321:05:243
86999140,14cyclictest0-21swapper/320:46:293
86999140,14cyclictest0-21swapper/319:35:103
86999140,14cyclictest0-21swapper/319:21:413
86999140,14cyclictest0-21swapper/319:12:053
86999140,0cyclictest0-21swapper/320:35:353
86999140,0cyclictest0-21swapper/319:45:193
865991414,0cyclictest0-21swapper/219:42:502
86599140,14cyclictest0-21swapper/220:55:382
86599140,14cyclictest0-21swapper/220:40:042
86599140,14cyclictest0-21swapper/220:26:252
86599140,14cyclictest0-21swapper/220:21:222
86599140,14cyclictest0-21swapper/220:16:332
86599140,14cyclictest0-21swapper/219:38:312
86599140,0cyclictest0-21swapper/220:47:482
86599140,0cyclictest0-21swapper/219:55:242
864991414,0cyclictest0-21swapper/121:07:521
86499140,14cyclictest0-21swapper/120:57:301
86499140,14cyclictest0-21swapper/120:40:031
86499140,14cyclictest0-21swapper/120:33:511
86499140,14cyclictest0-21swapper/120:12:061
86499140,14cyclictest0-21swapper/120:06:071
86499140,14cyclictest0-21swapper/119:59:311
86499140,14cyclictest0-21swapper/119:41:001
86499140,0cyclictest0-21swapper/119:11:361
863991414,0cyclictest0-21swapper/021:05:490
863991414,0cyclictest0-21swapper/020:07:160
863991414,0cyclictest0-21swapper/019:12:490
86399140,14cyclictest0-21swapper/019:40:100
86399140,0cyclictest0-21swapper/020:40:370
86399140,0cyclictest0-21swapper/020:32:120
86399140,0cyclictest0-21swapper/019:59:110
86399140,0cyclictest0-21swapper/019:35:310
869991313,0cyclictest0-21swapper/321:00:043
865991313,0cyclictest0-21swapper/220:01:522
865991313,0cyclictest0-21swapper/219:30:452
863991313,0cyclictest0-21swapper/020:13:000
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional