You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-20 - 09:20
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot2.osadl.org (updated Mon Oct 20, 2025 00:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
99702196180,11sleep10-21swapper/119:08:521
76012194178,11sleep00-21swapper/019:05:020
98632183166,12sleep30-21swapper/319:07:293
9852210588,12sleep20-21swapper/219:07:202
109112490,0sleep10-21swapper/122:33:321
45002450,0sleep00-21swapper/021:57:410
267402440,0sleep10-21swapper/100:19:331
314842420,0sleep10-21swapper/121:22:221
200132420,0sleep10-21swapper/122:54:391
200132420,0sleep10-21swapper/122:54:381
162632420,0sleep00-21swapper/021:30:390
102619991,6cyclictest0-21swapper/222:45:122
102529982,3cyclictest20546-21munin-run20:34:590
102529971,6cyclictest677-21kworker/0:222:35:170
3191260,0sleep10-21swapper/100:23:531
102669960,6cyclictest3913-21runrttasks23:18:573
102669960,1cyclictest0-21swapper/300:05:213
102619960,5cyclictest0-21swapper/222:15:142
102529961,5cyclictest677-21kworker/0:223:30:160
102529960,5cyclictest0-21swapper/021:40:150
102669955,0cyclictest0-21swapper/323:49:563
102669953,1cyclictest6206-21apt-get22:15:133
102669950,5cyclictest0-21swapper/323:09:203
102669950,5cyclictest0-21swapper/322:23:213
102669950,5cyclictest0-21swapper/321:26:193
102669950,0cyclictest0-21swapper/322:53:033
102669950,0cyclictest0-21swapper/322:53:023
102669950,0cyclictest0-21swapper/300:25:523
102619954,1cyclictest0-21swapper/223:22:012
102619950,5cyclictest0-21swapper/223:29:272
102619950,5cyclictest0-21swapper/221:26:562
102619950,5cyclictest0-21swapper/200:34:542
102619950,5cyclictest0-21swapper/200:01:522
102579950,5cyclictest0-21swapper/123:13:231
102579950,5cyclictest0-21swapper/122:25:381
102579950,5cyclictest0-21swapper/121:29:041
102579950,5cyclictest0-21swapper/120:42:461
102579950,5cyclictest0-21swapper/100:25:071
102529952,3cyclictest677-21kworker/0:223:40:130
102529950,5cyclictest18225-21ls23:10:000
102529950,5cyclictest0-21swapper/023:45:130
102529950,5cyclictest0-21swapper/023:36:420
102529950,4cyclictest646-21ssh00:38:590
102529950,4cyclictest6214-21ssh22:15:130
102669944,0cyclictest0-21swapper/323:01:113
102669944,0cyclictest0-21swapper/319:19:433
102669942,1cyclictest28228-21ssh00:03:523
102669940,4cyclictest32298-21irqstats21:55:173
102669940,4cyclictest0-21swapper/323:35:113
102669940,4cyclictest0-21swapper/323:30:123
102669940,4cyclictest0-21swapper/323:26:543
102669940,4cyclictest0-21swapper/322:59:093
102669940,4cyclictest0-21swapper/322:36:203
102669940,4cyclictest0-21swapper/322:32:373
102669940,4cyclictest0-21swapper/322:10:123
102669940,4cyclictest0-21swapper/322:07:483
102669940,4cyclictest0-21swapper/321:50:123
102669940,4cyclictest0-21swapper/321:41:003
102669940,4cyclictest0-21swapper/321:35:073
102669940,4cyclictest0-21swapper/321:20:123
102669940,4cyclictest0-21swapper/321:15:073
102669940,4cyclictest0-21swapper/321:10:153
102669940,4cyclictest0-21swapper/320:30:173
102669940,4cyclictest0-21swapper/320:25:113
102669940,4cyclictest0-21swapper/320:00:113
102669940,4cyclictest0-21swapper/300:37:203
102669940,4cyclictest0-21swapper/300:15:133
102669940,3cyclictest918-21sed21:00:003
102669940,3cyclictest25797-21rm22:25:023
102669940,3cyclictest25650-21cut20:44:593
102669940,3cyclictest20820-21sed21:50:003
102669940,3cyclictest2040-21tr22:45:143
102669940,3cyclictest18217-21latency_hist23:10:013
102669940,3cyclictest16209-21ssh23:40:463
102669940,3cyclictest12137-21cat20:15:213
102669940,3cyclictest11316-21ssh22:00:413
102669940,3cyclictest0-21swapper/320:50:103
102669940,3cyclictest0-21swapper/300:30:123
102669940,3cyclictest0-21swapper/300:20:123
102669940,2cyclictest0-21swapper/323:21:183
102669940,1cyclictest8100-21wget00:10:153
102669940,1cyclictest1761-21tune2fs23:50:183
102619944,0cyclictest0-21swapper/223:37:342
102619944,0cyclictest0-21swapper/223:05:002
102619944,0cyclictest0-21swapper/222:24:492
102619944,0cyclictest0-21swapper/222:11:272
102619944,0cyclictest0-21swapper/200:35:382
102619943,1cyclictest28784-21cut19:45:142
102619943,1cyclictest14563-21perl22:35:152
102619941,2cyclictest0-21swapper/222:05:152
102619941,2cyclictest0-21swapper/200:05:132
102619941,1cyclictest0-21swapper/221:15:142
102619941,0cyclictest0-21swapper/222:00:132
102619940,4cyclictest0-21swapper/223:53:562
102619940,4cyclictest0-21swapper/223:45:122
102619940,4cyclictest0-21swapper/223:31:322
102619940,4cyclictest0-21swapper/223:05:122
102619940,4cyclictest0-21swapper/222:55:122
102619940,4cyclictest0-21swapper/222:50:112
102619940,4cyclictest0-21swapper/222:50:112
102619940,4cyclictest0-21swapper/222:30:012
102619940,4cyclictest0-21swapper/221:55:132
102619940,4cyclictest0-21swapper/221:35:132
102619940,4cyclictest0-21swapper/221:23:332
102619940,4cyclictest0-21swapper/221:05:202
102619940,4cyclictest0-21swapper/220:50:122
102619940,4cyclictest0-21swapper/220:40:122
102619940,4cyclictest0-21swapper/219:55:122
102619940,4cyclictest0-21swapper/219:25:162
102619940,4cyclictest0-21swapper/219:15:132
102619940,4cyclictest0-21swapper/200:15:132
102619940,4cyclictest0-21swapper/200:10:132
102619940,3cyclictest9316-21if_eth020:10:172
102619940,3cyclictest6794-21df_inode21:10:162
102619940,3cyclictest588-21sh00:22:152
102619940,3cyclictest32632-21sh22:44:422
102619940,3cyclictest28350-21ssh23:15:012
102619940,3cyclictest26500-21diskstats19:40:152
102619940,3cyclictest23056-21ssh23:11:482
102619940,3cyclictest20136-21latency_hist00:00:012
102619940,3cyclictest18172-21wc20:30:002
102619940,3cyclictest15469-21sh21:46:432
102619940,3cyclictest14077-21df_inode23:40:142
102619940,3cyclictest11433-21rm00:27:522
102619940,1cyclictest938-21/usr/sbin/munin21:00:182
102619940,1cyclictest13767-21/usr/sbin/munin21:30:212
102619940,1cyclictest10349-21/usr/sbin/munin19:10:212
102619940,0cyclictest0-21swapper/221:41:462
102579944,0cyclictest0-21swapper/123:51:121
102579944,0cyclictest0-21swapper/123:34:111
102579944,0cyclictest0-21swapper/123:06:411
102579944,0cyclictest0-21swapper/122:37:341
102579944,0cyclictest0-21swapper/122:01:031
102579944,0cyclictest0-21swapper/121:54:231
102579944,0cyclictest0-21swapper/121:14:561
102579944,0cyclictest0-21swapper/100:02:161
102579942,1cyclictest0-21swapper/122:15:141
102579941,2cyclictest0-21swapper/123:40:121
102579941,2cyclictest0-21swapper/122:45:121
102579941,2cyclictest0-21swapper/122:40:121
102579941,2cyclictest0-21swapper/121:15:151
102579941,2cyclictest0-21swapper/120:00:111
102579941,2cyclictest0-21swapper/119:25:121
102579941,2cyclictest0-21swapper/119:15:111
102579941,1cyclictest0-21swapper/123:20:101
102579940,4cyclictest0-21swapper/100:38:201
102579940,0cyclictest0-21swapper/120:47:161
102529944,0cyclictest0-21swapper/021:22:510
102529943,1cyclictest0-21swapper/021:51:040
102529942,1cyclictest4369-21df_inode22:30:140
102529941,3cyclictest677-21kworker/0:222:05:090
102529941,2cyclictest29529-21ssh22:42:430
102529940,4cyclictest677-21kworker/0:219:25:180
102529940,4cyclictest25913-21apt-get20:45:010
102529940,4cyclictest16553-21memory00:30:160
102529940,4cyclictest12593-21munin-run19:15:010
102529940,4cyclictest0-21swapper/023:55:140
102529940,4cyclictest0-21swapper/023:50:150
102529940,4cyclictest0-21swapper/023:20:100
102529940,4cyclictest0-21swapper/023:00:010
102529940,4cyclictest0-21swapper/022:55:490
102529940,4cyclictest0-21swapper/022:25:130
102529940,4cyclictest0-21swapper/022:00:140
102529940,4cyclictest0-21swapper/021:36:590
102529940,4cyclictest0-21swapper/020:10:150
102529940,4cyclictest0-21swapper/000:25:120
102529940,4cyclictest0-21swapper/000:00:110
102529940,3cyclictest7760-21ssh00:10:050
102529940,3cyclictest3774-21ssh21:25:120
102529940,3cyclictest31220-21fschecks_count00:05:160
102529940,3cyclictest30638-21latency_hist20:54:590
102529940,3cyclictest29784-21grep19:45:200
102529940,3cyclictest2707-21ssh22:13:090
102529940,3cyclictest26494-21df_inode19:40:160
102529940,3cyclictest23340-21cut20:40:140
102529940,3cyclictest18791-21ssh23:10:130
102529940,3cyclictest18464-21cat19:25:010
102529940,3cyclictest18267-21date20:29:590
102529940,3cyclictest15917-21rm22:20:040
102529940,3cyclictest14164-21rm22:50:550
102529940,3cyclictest14164-21rm22:50:550
102529940,3cyclictest13564-21hddtemp_smartct19:15:020
102529940,3cyclictest0-21swapper/021:10:020
9871230,0sleep10-21swapper/121:44:281
102669932,1cyclictest714-21snmpd19:10:053
102669931,1cyclictest0-21swapper/319:55:123
102669930,3cyclictest28442-21apt-get19:45:143
102669930,3cyclictest21541-21diskstats19:30:143
102669930,3cyclictest13576-21seq21:30:063
102669930,3cyclictest10579-21ssh23:55:053
102669930,3cyclictest0-21swapper/322:40:103
102669930,3cyclictest0-21swapper/321:05:083
102669930,3cyclictest0-21swapper/321:00:123
102669930,3cyclictest0-21swapper/320:45:123
102669930,3cyclictest0-21swapper/320:35:113
102669930,3cyclictest0-21swapper/320:20:043
102669930,3cyclictest0-21swapper/320:10:133
102669930,3cyclictest0-21swapper/320:05:093
102669930,3cyclictest0-21swapper/319:50:123
102669930,3cyclictest0-21swapper/319:40:133
102669930,3cyclictest0-21swapper/319:35:123
102669930,3cyclictest0-21swapper/319:25:043
102669930,3cyclictest0-21swapper/319:20:143
102619931,1cyclictest0-21swapper/220:15:142
102619930,3cyclictest4541-21memory20:00:172
102619930,3cyclictest16077-21apt-get19:20:132
102619930,3cyclictest0-21swapper/220:55:142
102619930,3cyclictest0-21swapper/220:45:002
102619930,3cyclictest0-21swapper/220:35:022
102619930,3cyclictest0-21swapper/220:30:112
102619930,3cyclictest0-21swapper/220:20:082
102619930,3cyclictest0-21swapper/220:05:132
102619930,3cyclictest0-21swapper/219:50:032
102619930,3cyclictest0-21swapper/219:35:092
102619930,3cyclictest0-21swapper/219:30:132
102619930,1cyclictest27138-21if_eth122:25:162
102619930,1cyclictest21794-21diskstats21:50:152
102579933,0cyclictest0-21swapper/122:07:451
102579933,0cyclictest0-21swapper/121:35:441
102579933,0cyclictest0-21swapper/120:30:421
102579933,0cyclictest0-21swapper/119:37:531
102579931,1cyclictest11325-21chrt23:38:591
102579931,1cyclictest0-21swapper/123:45:121
102579931,1cyclictest0-21swapper/123:15:131
102579931,1cyclictest0-21swapper/123:00:121
102579931,1cyclictest0-21swapper/122:10:121
102579931,1cyclictest0-21swapper/121:45:101
102579931,1cyclictest0-21swapper/120:35:121
102579931,1cyclictest0-21swapper/120:20:111
102579931,1cyclictest0-21swapper/119:50:111
102579930,3cyclictest0-21swapper/121:03:001
102579930,2cyclictest22666-21chrt19:30:201
102579930,2cyclictest15827-21chrt20:25:091
102579930,2cyclictest0-21swapper/123:55:141
102579930,2cyclictest0-21swapper/123:25:111
102579930,2cyclictest0-21swapper/122:20:141
102529932,1cyclictest15862-21ssh21:15:020
102529931,1cyclictest714-21snmpd20:55:120
102529931,1cyclictest15507-21cron23:25:000
102529931,1cyclictest0-21swapper/019:50:120
102529930,3cyclictest677-21kworker/0:221:45:050
102529930,3cyclictest28538-21rm23:15:100
102529930,3cyclictest17897-21ssh00:15:060
102529930,3cyclictest1192-21ssh22:45:090
102529930,3cyclictest0-21swapper/021:05:070
102529930,3cyclictest0-21swapper/021:00:120
102529930,3cyclictest0-21swapper/020:35:110
102529930,3cyclictest0-21swapper/020:20:120
102529930,3cyclictest0-21swapper/020:15:060
102529930,3cyclictest0-21swapper/020:05:090
102529930,3cyclictest0-21swapper/020:00:110
102529930,3cyclictest0-21swapper/019:55:110
102529930,3cyclictest0-21swapper/019:35:150
102529930,3cyclictest0-21swapper/019:30:120
102529930,3cyclictest0-21swapper/000:20:120
102579921,1cyclictest303342chrt00:05:051
102579921,1cyclictest279802chrt19:42:181
102579921,1cyclictest210962chrt22:55:101
102579921,1cyclictest104452chrt20:12:451
102579921,1cyclictest0-21swapper/121:05:141
102579921,1cyclictest0-21swapper/120:15:141
102579921,1cyclictest0-21swapper/120:05:101
102579920,1cyclictest7891-21chrt00:10:081
102579920,1cyclictest3152-21chrt19:59:391
102579920,1cyclictest113392sleep119:10:201
102579920,1cyclictest0-21swapper/121:55:141
102579920,1cyclictest0-21swapper/121:30:141
102579920,1cyclictest0-21swapper/120:55:151
102579920,1cyclictest0-21swapper/120:50:101
102579920,1cyclictest0-21swapper/119:20:131
102579920,1cyclictest0-21swapper/100:30:131
102579910,1cyclictest0-21swapper/119:45:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional