You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-02 - 09:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Tue Dec 02, 2025 00:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
313692197181,11sleep00-21swapper/019:08:430
312982193178,10sleep10-21swapper/119:07:471
314332186170,12sleep20-21swapper/219:09:342
314192179162,12sleep30-21swapper/319:09:233
168512460,0sleep10-21swapper/121:36:211
113242450,0sleep30-21swapper/323:28:153
22762430,0sleep20-21swapper/223:07:002
301542380,0sleep30-21swapper/323:37:413
102892110,0sleep10-21swapper/123:44:231
3165299103,5cyclictest1292-21ssh21:12:372
3165299100,9cyclictest755-21apt-get21:45:132
3165299100,9cyclictest20314-21apt-get20:55:142
3165299100,5cyclictest19597-21ssh22:43:192
316529991,7cyclictest13202-21apt-get21:35:112
316529990,8cyclictest9784-21perf19:30:012
316529990,8cyclictest7544-21apt-get20:30:132
316529990,8cyclictest2576-21apt-get19:15:132
316529990,8cyclictest22809-21apt-get22:45:132
316529990,8cyclictest14611-21apt-get23:30:132
316529990,6cyclictest6181-21ssh23:58:352
316529990,6cyclictest30615-21ssh22:32:202
316529990,6cyclictest12235-21ssh22:23:172
316529990,6cyclictest11309-21ssh22:06:072
316529990,5cyclictest6993-21chrt20:26:102
316529990,5cyclictest6976-21chrt19:21:022
316529990,5cyclictest5842-21ssh23:41:322
316529990,5cyclictest5775-21ssh22:52:342
316529990,5cyclictest44972sleep220:20:502
316529990,5cyclictest4206-21taskset22:02:562
316529990,5cyclictest3306-21chrt00:13:352
316529990,5cyclictest32037-21chrt20:11:582
316529990,5cyclictest29576-21chrt20:07:092
316529990,5cyclictest27398-21chrt21:08:482
316529990,5cyclictest27398-21chrt21:08:482
316529990,5cyclictest26933-21chrt20:03:042
316529990,5cyclictest25336-21ssh22:13:442
316529990,5cyclictest20324-21chrt21:21:562
316529990,5cyclictest19332-21chrt19:45:562
316529990,5cyclictest14458-21chrt19:36:582
316529990,5cyclictest11908-21taskset19:30:582
316529990,0cyclictest15740-21ssh23:46:342
26398290,0sleep10-21swapper/121:41:051
316529980,7cyclictest9962-21if_eth400:00:152
316529980,7cyclictest32527-21apt-get20:15:132
316529980,7cyclictest26410-21fschecks_count21:25:182
316529980,7cyclictest24493-21apt23:35:142
316529980,7cyclictest22371-21apt-get19:55:132
316529980,7cyclictest21597-21apt-get23:50:112
316529980,7cyclictest17366-21ssh23:15:132
316529980,7cyclictest13332-21apt-get00:35:132
316529980,7cyclictest11582-21sort21:50:162
316529980,7cyclictest10010-21apt-get20:35:122
316529980,5cyclictest8036-21ssh21:32:052
316529980,5cyclictest7393-21ssh23:10:082
316529980,5cyclictest711-21runrttasks20:41:042
316529980,5cyclictest5168-21ssh22:35:262
316529980,5cyclictest3371-21ssh00:30:082
316529980,5cyclictest31768-21sshd00:27:422
316529980,5cyclictest30091-21ssh22:15:262
316529980,5cyclictest29478-21ssh23:20:282
316529980,5cyclictest25821-21ssh23:02:402
316529980,5cyclictest22914-21ssh21:40:022
316529980,5cyclictest20394-21ssh21:55:062
316529980,5cyclictest19888-21taskset19:50:052
316529980,5cyclictest19705-21taskset20:50:252
316529980,5cyclictest18668-21ssh22:26:032
316529980,5cyclictest17438-21ssh22:58:392
316529980,5cyclictest17042-21chrt19:43:112
316529980,5cyclictest1302-21taskset19:11:462
316529980,4cyclictest8980-21taskset21:16:072
316529980,4cyclictest0-21swapper/200:20:342
316529980,4cyclictest0-21swapper/200:05:152
316529980,0cyclictest0-21swapper/200:15:082
316529970,7cyclictest17417-21perf20:50:012
316529970,0cyclictest0-21swapper/223:25:092
316529960,6cyclictest24471-21cat21:00:212
316579955,0cyclictest9711-21kworker/3:022:30:153
316579954,1cyclictest0-21swapper/323:34:523
316579950,5cyclictest0-21swapper/322:47:263
316579950,5cyclictest0-21swapper/321:50:133
316489955,0cyclictest0-21swapper/121:22:411
316489951,3cyclictest0-21swapper/121:30:131
316489951,2cyclictest0-21swapper/100:00:111
316489950,5cyclictest0-21swapper/123:09:291
316479955,0cyclictest0-21swapper/000:10:140
316479950,5cyclictest0-21swapper/023:42:010
316479950,5cyclictest0-21swapper/022:03:390
316479950,5cyclictest0-21swapper/021:50:170
316479950,4cyclictest0-21swapper/019:30:130
316479950,0cyclictest27511-21diskmemload22:44:420
316579944,0cyclictest20725-21kworker/3:223:03:513
316579944,0cyclictest1781-21kworker/3:119:42:203
316579944,0cyclictest1781-21kworker/3:119:31:073
316579944,0cyclictest0-21swapper/322:20:143
316579943,1cyclictest5791-21perl19:20:143
316579943,1cyclictest17838-21/usr/sbin/munin20:50:153
316579942,1cyclictest714-21snmpd19:38:213
316579941,1cyclictest0-21swapper/300:15:123
316579940,4cyclictest7539-21/usr/sbin/munin19:25:193
316579940,4cyclictest55950irq/130-eth000:30:103
316579940,4cyclictest31525-21/usr/sbin/munin23:55:163
316579940,4cyclictest28008-21/usr/sbin/munin21:10:153
316579940,4cyclictest0-21swapper/323:42:363
316579940,4cyclictest0-21swapper/323:22:273
316579940,4cyclictest0-21swapper/323:05:153
316579940,4cyclictest0-21swapper/322:35:013
316579940,4cyclictest0-21swapper/322:26:283
316579940,4cyclictest0-21swapper/322:15:183
316579940,4cyclictest0-21swapper/321:55:143
316579940,4cyclictest0-21swapper/321:45:143
316579940,4cyclictest0-21swapper/321:40:143
316579940,4cyclictest0-21swapper/321:21:523
316579940,4cyclictest0-21swapper/320:39:493
316579940,4cyclictest0-21swapper/320:25:083
316579940,4cyclictest0-21swapper/320:05:173
316579940,4cyclictest0-21swapper/320:00:153
316579940,4cyclictest0-21swapper/319:17:283
316579940,4cyclictest0-21swapper/300:35:123
316579940,4cyclictest0-21swapper/300:05:213
316579940,3cyclictest9534-21sh21:16:293
316579940,3cyclictest6279-21sh21:30:573
316579940,3cyclictest3880-21ntpq20:20:193
316579940,3cyclictest32524-21/usr/sbin/munin20:15:213
316579940,3cyclictest31011-21ssh21:27:233
316579940,3cyclictest27204-21memory00:25:163
316579940,3cyclictest24148-21ssh00:24:093
316579940,3cyclictest22803-21memory23:50:153
316579940,3cyclictest20643-21perl19:50:143
316579940,3cyclictest17934-21ssh21:37:013
316579940,3cyclictest10176-21/usr/sbin/munin22:55:213
316579940,3cyclictest10118-21memory00:00:173
316579940,1cyclictest28669-21/usr/sbin/munin00:10:183
316579940,1cyclictest20311-21/usr/sbin/munin20:55:193
316579940,1cyclictest17429-21/usr/sbin/munin19:45:163
316579940,1cyclictest12897-21/usr/sbin/munin22:40:183
316579940,0cyclictest32455-21perl19:10:153
316579940,0cyclictest0-21swapper/322:00:253
316489944,0cyclictest0-21swapper/123:45:521
316489944,0cyclictest0-21swapper/123:13:591
316489944,0cyclictest0-21swapper/122:52:541
316489944,0cyclictest0-21swapper/122:30:211
316489944,0cyclictest0-21swapper/121:53:051
316489944,0cyclictest0-21swapper/121:46:241
316489941,2cyclictest0-21swapper/123:55:141
316489941,2cyclictest0-21swapper/122:40:121
316489941,2cyclictest0-21swapper/121:55:141
316489941,2cyclictest0-21swapper/121:05:141
316489941,2cyclictest0-21swapper/121:05:131
316489941,2cyclictest0-21swapper/120:55:141
316489941,2cyclictest0-21swapper/120:15:141
316489941,2cyclictest0-21swapper/120:05:161
316489941,2cyclictest0-21swapper/119:55:141
316489941,2cyclictest0-21swapper/119:50:131
316489940,4cyclictest0-21swapper/122:05:461
316489940,4cyclictest0-21swapper/100:25:341
316489940,3cyclictest0-21swapper/122:45:121
316479944,0cyclictest0-21swapper/023:38:580
316479944,0cyclictest0-21swapper/023:11:460
316479944,0cyclictest0-21swapper/022:17:030
316479944,0cyclictest0-21swapper/021:10:150
316479942,2cyclictest714-21snmpd23:16:060
316479942,2cyclictest714-21snmpd20:36:290
316479941,1cyclictest170972ssh00:36:250
316479941,1cyclictest0-21swapper/022:55:120
316479940,4cyclictest14739-21apt20:45:000
316479940,4cyclictest0-21swapper/023:50:110
316479940,4cyclictest0-21swapper/023:45:110
316479940,4cyclictest0-21swapper/023:30:140
316479940,4cyclictest0-21swapper/023:01:130
316479940,4cyclictest0-21swapper/022:45:120
316479940,4cyclictest0-21swapper/022:25:130
316479940,4cyclictest0-21swapper/022:20:070
316479940,4cyclictest0-21swapper/022:05:570
316479940,4cyclictest0-21swapper/021:55:140
316479940,4cyclictest0-21swapper/021:40:150
316479940,4cyclictest0-21swapper/021:35:110
316479940,4cyclictest0-21swapper/021:20:130
316479940,4cyclictest0-21swapper/020:30:140
316479940,4cyclictest0-21swapper/020:29:570
316479940,4cyclictest0-21swapper/020:20:130
316479940,4cyclictest0-21swapper/000:30:100
316479940,4cyclictest0-21swapper/000:25:120
316479940,4cyclictest0-21swapper/000:20:100
316479940,4cyclictest0-21swapper/000:15:010
316479940,4cyclictest0-21swapper/000:05:110
316479940,3cyclictest5085-21ssh21:46:500
316479940,3cyclictest4383-21ssh23:08:230
316479940,3cyclictest28858-21ntp_states20:05:230
316479940,3cyclictest25395-21diskstats20:00:160
316479940,3cyclictest0-21swapper/023:25:130
316479940,3cyclictest0-21swapper/022:50:110
316479940,3cyclictest0-21swapper/020:45:130
316579931,1cyclictest0-21swapper/320:40:123
316579930,3cyclictest72212sleep323:10:033
316579930,3cyclictest17788-21sh22:10:073
316579930,3cyclictest17162-21sh23:15:063
316579930,3cyclictest15624-21expr20:45:143
316579930,3cyclictest0-21swapper/323:45:063
316579930,3cyclictest0-21swapper/322:50:123
316579930,3cyclictest0-21swapper/322:05:013
316579930,3cyclictest0-21swapper/321:05:053
316579930,3cyclictest0-21swapper/321:05:053
316579930,3cyclictest0-21swapper/321:00:083
316579930,3cyclictest0-21swapper/320:30:143
316579930,3cyclictest0-21swapper/320:10:053
316579930,3cyclictest0-21swapper/319:55:133
316489933,0cyclictest0-21swapper/123:30:341
316489933,0cyclictest0-21swapper/122:18:241
316489932,1cyclictest0-21swapper/119:20:121
316489931,1cyclictest0-21swapper/123:50:121
316489931,1cyclictest0-21swapper/123:15:121
316489931,1cyclictest0-21swapper/123:00:151
316489931,1cyclictest0-21swapper/122:20:131
316489931,1cyclictest0-21swapper/122:10:111
316489931,1cyclictest0-21swapper/121:15:121
316489931,1cyclictest0-21swapper/121:10:131
316489931,1cyclictest0-21swapper/121:00:121
316489931,1cyclictest0-21swapper/120:40:121
316489931,1cyclictest0-21swapper/120:35:111
316489931,1cyclictest0-21swapper/120:25:141
316489931,1cyclictest0-21swapper/120:00:151
316489931,1cyclictest0-21swapper/119:45:111
316489931,1cyclictest0-21swapper/119:40:131
316489931,1cyclictest0-21swapper/119:35:131
316489931,1cyclictest0-21swapper/119:30:141
316489931,1cyclictest0-21swapper/100:35:121
316489931,1cyclictest0-21swapper/100:30:091
316489931,1cyclictest0-21swapper/100:15:021
316489931,1cyclictest0-21swapper/100:10:131
316489930,2cyclictest96612sleep120:33:421
316489930,2cyclictest18804-21chrt22:26:091
316489930,2cyclictest0-21swapper/121:25:151
316489930,2cyclictest0-21swapper/120:50:131
316489930,2cyclictest0-21swapper/120:20:141
316489930,2cyclictest0-21swapper/100:05:111
316489930,1cyclictest0-21swapper/119:25:141
316479932,1cyclictest26710-21hddtemp_smartct21:25:170
316479932,1cyclictest225-21systemd-journal20:50:010
316479931,2cyclictest0-21swapper/019:15:120
316479931,1cyclictest12473-21apt-get19:35:130
316479930,3cyclictest9247-21expr00:00:130
316479930,3cyclictest6353-21cut21:15:140
316479930,3cyclictest31416-21ssh23:55:100
316479930,3cyclictest27511-21diskmemload22:10:030
316479930,3cyclictest26541-21ntp_states21:05:180
316479930,3cyclictest26541-21ntp_states21:05:180
316479930,3cyclictest0-21swapper/023:20:130
316479930,3cyclictest0-21swapper/022:35:150
316479930,3cyclictest0-21swapper/022:30:120
316479930,3cyclictest0-21swapper/021:30:120
316479930,3cyclictest0-21swapper/021:00:130
316479930,3cyclictest0-21swapper/020:55:050
316479930,3cyclictest0-21swapper/020:15:020
316479930,3cyclictest0-21swapper/020:10:120
316479930,3cyclictest0-21swapper/019:55:010
316479930,3cyclictest0-21swapper/019:50:120
316479930,3cyclictest0-21swapper/019:45:060
316479930,3cyclictest0-21swapper/019:40:140
316479930,3cyclictest0-21swapper/019:25:130
316479930,3cyclictest0-21swapper/019:20:040
316479930,1cyclictest0-21swapper/019:10:110
316489922,0cyclictest0-21swapper/122:36:181
316489921,1cyclictest0-21swapper/122:00:121
316489921,1cyclictest0-21swapper/119:15:121
316489921,1cyclictest0-21swapper/119:10:111
316489921,1cyclictest0-21swapper/100:20:101
316489920,2cyclictest0-21swapper/120:10:121
316489920,1cyclictest0-21swapper/123:35:131
316489920,1cyclictest0-21swapper/123:25:141
316489920,1cyclictest0-21swapper/123:20:121
316489920,1cyclictest0-21swapper/122:55:131
316489920,1cyclictest0-21swapper/120:45:021
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional