You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-24 - 11:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5.osadl.org (updated Sat May 24, 2025 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1377599340,28cyclictest303-21systemd-journal22:50:001
13776993028,1cyclictest30872-21apt-get20:55:132
1377699300,29cyclictest4505-21apt-get23:25:142
1377699300,1cyclictest303-21systemd-journal23:25:002
13777992927,1cyclictest4222-21awk23:25:003
13777992927,1cyclictest24785-21apt-config23:00:023
1377799290,28cyclictest22115-21apt-get21:45:133
1377799290,28cyclictest0-21swapper/322:55:023
13776992928,0cyclictest0-21swapper/200:00:132
1377699290,28cyclictest32254-21apt-get23:15:132
1377699290,28cyclictest0-21swapper/223:00:012
1377699290,28cyclictest0-21swapper/222:10:012
1377699290,28cyclictest0-21swapper/222:00:102
13775992928,1cyclictest10947-21apt-get22:30:141
13774992927,1cyclictest609-21dbus-daemon00:35:010
13774992927,1cyclictest6044-21sendmail-msp22:20:010
13777992827,0cyclictest0-21swapper/322:30:133
1377799280,0cyclictest0-21swapper/300:15:153
13776992828,0cyclictest9150-21apt-get23:35:142
13776992828,0cyclictest0-21swapper/223:45:152
13776992827,1cyclictest0-21swapper/222:40:142
13776992826,1cyclictest5185-21munin-run21:10:002
13775992828,0cyclictest0-21swapper/122:40:131
13775992827,1cyclictest25290-21apt-get23:00:141
1377599280,0cyclictest0-21swapper/121:50:121
13774992828,0cyclictest2573-21apt-get19:55:130
13774992826,1cyclictest2513-21cron00:30:010
1377499280,27cyclictest23350-21apt-get19:30:100
1377499280,0cyclictest0-21swapper/021:50:120
1377499280,0cyclictest0-21swapper/019:40:180
1377499280,0cyclictest0-21swapper/019:20:140
13777992727,0cyclictest0-21swapper/323:25:133
13777992727,0cyclictest0-21swapper/321:05:153
13777992727,0cyclictest0-21swapper/319:20:153
1377799270,27cyclictest0-21swapper/322:35:163
13776992727,0cyclictest0-21swapper/223:00:142
13776992727,0cyclictest0-21swapper/200:10:172
1377699270,0cyclictest0-21swapper/220:35:112
13775992727,0cyclictest0-21swapper/121:25:001
1377599270,27cyclictest0-21swapper/121:55:121
13774992727,0cyclictest23907-21apt-get20:40:150
13774992727,0cyclictest0-21swapper/022:05:020
13774992727,0cyclictest0-21swapper/021:15:130
13774992726,1cyclictest26759-21apt-get21:55:120
13777992626,0cyclictest0-21swapper/323:40:163
13777992626,0cyclictest0-21swapper/320:55:123
13777992626,0cyclictest0-21swapper/320:10:143
13777992625,1cyclictest0-21swapper/323:00:033
13776992624,1cyclictest9570-21idleruntime-cro20:10:012
13775992626,0cyclictest21561-21apt-get20:35:111
13775992626,0cyclictest18659-21apt-get19:20:141
13775992626,0cyclictest0-21swapper/123:35:131
13775992626,0cyclictest0-21swapper/120:55:121
13775992624,1cyclictest9824-21cron21:20:001
13775992624,1cyclictest303-21systemd-journal21:15:001
13775992623,3cyclictest0-21swapper/120:10:131
13774992626,0cyclictest0-21swapper/023:10:150
13777992525,0cyclictest417-21apt-get00:25:143
13777992525,0cyclictest0-21swapper/323:55:163
13776992525,0cyclictest0-21swapper/219:15:122
13776992523,1cyclictest0-21swapper/219:55:002
13775992525,0cyclictest5114-21apt-get00:35:141
13774992525,0cyclictest0-21swapper/023:30:150
13774992525,0cyclictest0-21swapper/019:50:130
13774992525,0cyclictest0-21swapper/019:15:120
13777992424,0cyclictest1356-21perf22:10:023
13777992424,0cyclictest0-21swapper/323:15:133
13777992424,0cyclictest0-21swapper/321:35:133
13777992424,0cyclictest0-21swapper/320:35:113
13776992424,0cyclictest10111-21apt-get21:20:112
13776992423,0cyclictest11498-21apt-get23:40:152
13775992424,0cyclictest14539-21apt-get20:20:131
13775992424,0cyclictest0-21swapper/120:40:151
13774992423,1cyclictest12187-21apt-get20:15:150
13777992323,0cyclictest0-21swapper/323:45:163
13777992323,0cyclictest0-21swapper/323:35:133
13777992323,0cyclictest0-21swapper/322:40:133
13777992323,0cyclictest0-21swapper/322:00:113
13777992323,0cyclictest0-21swapper/300:00:133
13776992323,0cyclictest0-21swapper/219:20:162
13776992323,0cyclictest0-21swapper/200:15:162
13776992322,1cyclictest4652-21apt-get20:00:032
13776992321,1cyclictest9853-21munin-run21:20:002
13775992323,0cyclictest0-21swapper/122:35:161
13775992323,0cyclictest0-21swapper/122:15:151
13775992323,0cyclictest0-21swapper/100:00:141
13774992323,0cyclictest0-21swapper/023:40:150
13774992323,0cyclictest0-21swapper/022:00:110
13774992323,0cyclictest0-21swapper/020:05:120
13774992322,1cyclictest0-21swapper/020:50:120
13777992222,0cyclictest0-21swapper/300:10:163
13776992222,0cyclictest0-21swapper/223:55:162
13774992222,0cyclictest0-21swapper/021:25:140
13774992222,0cyclictest0-21swapper/019:45:140
13774992221,1cyclictest4505-21apt-get23:25:130
13777992119,1cyclictest0-21swapper/320:10:013
13775992121,0cyclictest0-21swapper/122:55:171
13775992121,0cyclictest0-21swapper/122:25:171
13775992121,0cyclictest0-21swapper/120:00:021
13775992119,2cyclictest1890-21sh23:20:011
13774992120,1cyclictest11231-21perf23:40:010
13777992020,0cyclictest0-21swapper/319:15:123
13776992020,0cyclictest0-21swapper/222:15:012
13776992019,1cyclictest13273-21apt-get22:35:172
13776992018,1cyclictest626-21gdbus20:49:592
13775992020,0cyclictest19740-21apt-get21:40:161
13775992019,1cyclictest29100-21apt-get22:00:101
13774992020,0cyclictest0-21swapper/021:35:140
13774992020,0cyclictest0-21swapper/020:55:120
13774992020,0cyclictest0-21swapper/020:35:120
13777991919,0cyclictest0-21swapper/321:20:113
13776991919,0cyclictest3959-21apt-get22:15:152
13776991919,0cyclictest0-21swapper/222:30:132
13776991919,0cyclictest0-21swapper/220:20:132
13776991919,0cyclictest0-21swapper/200:35:142
13776991918,0cyclictest0-21swapper/220:10:132
13776991917,1cyclictest31970-21basename23:15:002
13776991917,1cyclictest0-21swapper/219:45:012
13775991919,0cyclictest13829-21apt-get23:45:151
13774991919,0cyclictest0-21swapper/022:55:170
13774991919,0cyclictest0-21swapper/021:30:140
13774991919,0cyclictest0-21swapper/020:00:020
13777991818,0cyclictest2302-21perf19:55:003
13776991818,0cyclictest0-21swapper/221:40:012
13776991816,1cyclictest10657-21idleruntime-cro22:30:002
13775991818,0cyclictest16307-21apt-get19:15:131
13775991818,0cyclictest0-21swapper/123:40:151
13775991818,0cyclictest0-21swapper/100:25:131
13774991818,0cyclictest0-21swapper/023:45:150
13774991818,0cyclictest0-21swapper/020:35:010
13777991717,0cyclictest0-21swapper/320:00:023
13775991717,0cyclictest0-21swapper/123:25:141
13775991717,0cyclictest0-21swapper/100:10:171
1377599170,7cyclictest0-21swapper/122:05:121
13774991717,0cyclictest0-21swapper/000:15:150
13774991715,2cyclictest31495-21snmpd00:04:380
13777991616,0cyclictest0-21swapper/321:20:013
13777991615,1cyclictest3699-21munin-run22:15:013
1377699164,11cyclictest1708-21apache221:34:272
13776991616,0cyclictest0-21swapper/222:50:172
1377699160,15cyclictest25968-21munin-run20:44:592
13775991614,1cyclictest19175-21munin-run21:40:011
13774991614,1cyclictest0-21swapper/023:23:010
1377499160,2cyclictest21741-21chrt21:44:060
13777991513,1cyclictest27821-21sed20:45:213
1377799150,1cyclictest24858-21diskstats21:50:133
1377799150,1cyclictest0-21swapper/321:40:203
1377799150,1cyclictest0-21swapper/300:31:363
1377799150,14cyclictest0-21swapper/319:40:193
1377799150,14cyclictest0-21swapper/319:30:143
13776991513,1cyclictest24957-21perl21:50:152
1377699150,1cyclictest25414-21perf19:35:012
1377699150,1cyclictest0-21swapper/219:25:132
1377699150,14cyclictest0-21swapper/220:55:012
13775991515,0cyclictest0-21swapper/121:05:141
13774991515,0cyclictest0-21swapper/021:20:120
13774991513,1cyclictest27056-21chrt23:01:450
13774991513,1cyclictest0-21swapper/019:25:150
1377499150,1cyclictest878-21ntp_states23:15:200
1377499150,15cyclictest24221-21latency_hist21:50:000
1377499150,14cyclictest0-21swapper/020:25:200
1377499150,14cyclictest0-21swapper/000:38:510
1377799143,6cyclictest6797-21/usr/sbin/munin23:30:193
13777991414,0cyclictest0-21swapper/322:20:463
13777991414,0cyclictest0-21swapper/322:15:153
13777991414,0cyclictest0-21swapper/321:11:383
13777991414,0cyclictest0-21swapper/320:41:223
13777991414,0cyclictest0-21swapper/320:20:133
13777991414,0cyclictest0-21swapper/320:18:013
13777991414,0cyclictest0-21swapper/300:35:143
1377799140,1cyclictest0-21swapper/321:25:133
1377799140,14cyclictest0-21swapper/323:52:403
1377799140,14cyclictest0-21swapper/323:11:193
1377799140,14cyclictest0-21swapper/322:25:423
1377799140,14cyclictest0-21swapper/321:55:543
1377799140,14cyclictest0-21swapper/321:34:423
1377799140,14cyclictest0-21swapper/320:51:043
1377799140,14cyclictest0-21swapper/320:28:293
1377799140,14cyclictest0-21swapper/319:45:353
1377799140,14cyclictest0-21swapper/319:35:533
1377799140,14cyclictest0-21swapper/319:12:073
1377799140,14cyclictest0-21swapper/300:24:583
1377799140,14cyclictest0-21swapper/300:05:423
1377799140,0cyclictest0-21swapper/323:09:473
1377799140,0cyclictest0-21swapper/321:00:403
1377799140,0cyclictest0-21swapper/320:31:053
1377799140,0cyclictest0-21swapper/319:56:233
1377799140,0cyclictest0-21swapper/319:28:143
13776991414,0cyclictest0-21swapper/223:30:152
13776991414,0cyclictest0-21swapper/221:14:342
13776991414,0cyclictest0-21swapper/200:28:132
1377699140,14cyclictest0-21swapper/222:45:202
1377699140,14cyclictest0-21swapper/222:20:142
1377699140,14cyclictest0-21swapper/221:58:122
1377699140,14cyclictest0-21swapper/221:46:112
1377699140,14cyclictest0-21swapper/221:35:042
1377699140,14cyclictest0-21swapper/220:31:332
1377699140,14cyclictest0-21swapper/220:27:322
1377699140,14cyclictest0-21swapper/220:17:422
1377699140,14cyclictest0-21swapper/219:55:152
1377699140,14cyclictest0-21swapper/219:45:572
1377699140,14cyclictest0-21swapper/219:39:262
1377699140,14cyclictest0-21swapper/219:11:562
1377699140,14cyclictest0-21swapper/200:08:242
1377699140,0cyclictest0-21swapper/221:00:092
1377699140,0cyclictest0-21swapper/200:30:172
13775991414,0cyclictest0-21swapper/121:47:491
13775991414,0cyclictest0-21swapper/121:02:041
13775991414,0cyclictest0-21swapper/120:25:511
13775991414,0cyclictest0-21swapper/120:15:161
13775991414,0cyclictest0-21swapper/119:50:351
13775991414,0cyclictest0-21swapper/119:32:371
13775991414,0cyclictest0-21swapper/119:25:151
13775991414,0cyclictest0-21swapper/100:20:141
13775991414,0cyclictest0-21swapper/100:16:591
13775991414,0cyclictest0-21swapper/100:05:531
1377599140,14cyclictest13839-21ssh21:25:211
1377599140,14cyclictest0-21swapper/123:51:011
1377599140,14cyclictest0-21swapper/123:30:091
1377599140,14cyclictest0-21swapper/123:10:051
1377599140,14cyclictest0-21swapper/123:05:581
1377599140,14cyclictest0-21swapper/122:52:551
1377599140,14cyclictest0-21swapper/122:10:341
1377599140,14cyclictest0-21swapper/121:30:281
1377599140,14cyclictest0-21swapper/120:50:391
1377599140,14cyclictest0-21swapper/120:47:261
1377599140,14cyclictest0-21swapper/119:55:461
1377599140,14cyclictest0-21swapper/119:40:101
1377599140,14cyclictest0-21swapper/119:36:101
1377599140,14cyclictest0-21swapper/119:14:391
1377599140,14cyclictest0-21swapper/100:30:501
1377599140,0cyclictest0-21swapper/123:55:471
1377599140,0cyclictest0-21swapper/123:21:241
1377599140,0cyclictest0-21swapper/122:20:501
1377599140,0cyclictest0-21swapper/120:30:511
1377599140,0cyclictest0-21swapper/120:05:121
1377599140,0cyclictest0-21swapper/119:46:181
13774991414,0cyclictest0-21swapper/022:41:340
13774991414,0cyclictest0-21swapper/000:21:110
13774991412,1cyclictest2539-21memory22:10:190
13774991412,1cyclictest0-21swapper/023:50:220
1377499140,14cyclictest0-21swapper/023:56:200
1377499140,14cyclictest0-21swapper/023:05:050
1377499140,14cyclictest0-21swapper/022:48:150
1377499140,14cyclictest0-21swapper/022:35:300
1377499140,14cyclictest0-21swapper/022:32:520
1377499140,14cyclictest0-21swapper/021:11:360
1377499140,14cyclictest0-21swapper/021:00:440
1377499140,14cyclictest0-21swapper/020:20:320
1377499140,14cyclictest0-21swapper/020:10:410
1377499140,14cyclictest0-21swapper/019:35:350
1377499140,14cyclictest0-21swapper/019:11:390
1377499140,0cyclictest0-21swapper/022:52:060
1377499140,0cyclictest0-21swapper/022:21:500
1377499140,0cyclictest0-21swapper/021:08:340
1377499140,0cyclictest0-21swapper/020:45:130
1377499140,0cyclictest0-21swapper/000:10:340
1377499140,0cyclictest0-21swapper/000:07:580
13776991313,0cyclictest0-21swapper/223:52:202
13776991313,0cyclictest0-21swapper/223:05:242
13776991313,0cyclictest0-21swapper/221:26:252
13774991313,0cyclictest0-21swapper/022:25:330
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional