You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-20 - 18:57
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot2.osadl.org (updated Mon Oct 20, 2025 12:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
117182204188,11sleep10-21swapper/107:08:231
93882199181,13sleep30-21swapper/307:05:013
117072195178,12sleep00-21swapper/007:08:150
118162187170,12sleep20-21swapper/207:09:412
315682610,0sleep20-21swapper/209:20:522
279792460,0sleep10-21swapper/112:18:211
294432450,0sleep20-21swapper/211:13:492
83552430,0sleep00-21swapper/009:58:210
260572420,0sleep10-21swapper/111:11:411
74602410,0sleep10-21swapper/112:24:431
302742410,0sleep330276-21latency_hist07:45:013
109562410,0sleep10-21swapper/109:10:331
138872140,0sleep10-21swapper/110:33:401
296322120,0sleep00-21swapper/010:41:010
3692110,0sleep10-21swapper/111:15:171
3383290,0sleep10-21swapper/109:00:131
9949280,0sleep09952-21pmu-power12:25:180
120429982,6cyclictest23351-21kworker/0:007:15:140
120429982,3cyclictest3411-21munin-run09:40:020
120429981,6cyclictest23351-21kworker/0:008:35:120
120519973,1cyclictest0-21swapper/210:50:132
120429972,5cyclictest23351-21kworker/0:012:39:240
120429972,5cyclictest23351-21kworker/0:012:30:260
120429972,5cyclictest23351-21kworker/0:012:30:260
120429972,5cyclictest23351-21kworker/0:012:14:560
120429972,5cyclictest23351-21kworker/0:011:59:030
120429972,5cyclictest23351-21kworker/0:011:13:540
120429972,5cyclictest23351-21kworker/0:010:19:480
120429972,5cyclictest23351-21kworker/0:009:33:510
120429971,6cyclictest23351-21kworker/0:011:20:520
120429971,5cyclictest23351-21kworker/0:011:15:400
120429970,3cyclictest8038-21diskmemload10:25:010
120429962,4cyclictest23351-21kworker/0:012:00:560
120429962,4cyclictest23351-21kworker/0:011:25:400
120429962,4cyclictest23351-21kworker/0:011:09:500
120429962,4cyclictest23351-21kworker/0:007:35:220
120429961,5cyclictest23351-21kworker/0:012:24:150
120429961,5cyclictest23351-21kworker/0:012:18:020
120429961,5cyclictest23351-21kworker/0:012:05:320
120429961,5cyclictest23351-21kworker/0:011:50:080
120429961,5cyclictest23351-21kworker/0:011:47:440
120429961,5cyclictest23351-21kworker/0:011:44:140
120429961,5cyclictest23351-21kworker/0:011:35:100
120429961,5cyclictest23351-21kworker/0:011:30:250
120429961,5cyclictest23351-21kworker/0:010:55:140
120429961,5cyclictest23351-21kworker/0:010:50:400
120429961,5cyclictest23351-21kworker/0:010:45:160
120429961,5cyclictest23351-21kworker/0:010:36:110
120429961,5cyclictest23351-21kworker/0:010:31:060
120429961,5cyclictest23351-21kworker/0:010:25:070
120429961,5cyclictest23351-21kworker/0:010:11:340
120429961,5cyclictest23351-21kworker/0:010:08:210
120429961,5cyclictest23351-21kworker/0:010:01:170
120429961,5cyclictest23351-21kworker/0:009:53:360
120429961,5cyclictest23351-21kworker/0:009:41:030
120429961,5cyclictest23351-21kworker/0:009:25:300
120429961,5cyclictest23351-21kworker/0:009:22:120
120429961,5cyclictest23351-21kworker/0:009:15:350
120429961,5cyclictest23351-21kworker/0:009:10:210
120429961,5cyclictest23351-21kworker/0:007:55:110
120429961,5cyclictest23351-21kworker/0:007:25:170
120429960,6cyclictest23351-21kworker/0:011:00:110
120569955,0cyclictest10373-21kworker/3:012:07:593
120569955,0cyclictest10373-21kworker/3:011:23:123
120569955,0cyclictest0-21swapper/311:17:193
120569954,1cyclictest0-21swapper/310:10:233
120569951,4cyclictest714-21snmpd11:37:013
120569951,3cyclictest0-21swapper/309:20:153
120569950,5cyclictest0-21swapper/311:53:593
120569950,4cyclictest15369-21apt-get07:15:103
120569950,4cyclictest13656-21python07:10:223
120569950,0cyclictest0-21swapper/310:45:443
120519955,0cyclictest0-21swapper/210:00:062
120519954,1cyclictest14853-21ssh09:29:252
120519950,5cyclictest0-21swapper/212:31:432
120519950,5cyclictest0-21swapper/212:31:432
120519950,5cyclictest0-21swapper/210:17:092
120519950,0cyclictest0-21swapper/212:11:572
120469951,2cyclictest0-21swapper/112:05:121
120469951,2cyclictest0-21swapper/108:20:121
120469951,1cyclictest0-21swapper/109:55:111
120469950,5cyclictest0-21swapper/112:35:391
120469950,2cyclictest0-21swapper/112:30:131
120469950,2cyclictest0-21swapper/112:30:131
120429952,3cyclictest23351-21kworker/0:009:45:240
120429951,4cyclictest23351-21kworker/0:008:05:160
120429951,4cyclictest23351-21kworker/0:007:40:200
120429950,5cyclictest23351-21kworker/0:008:45:120
120429950,5cyclictest0-21swapper/008:50:000
120429950,5cyclictest0-21swapper/008:25:160
120429950,1cyclictest25036-21idleruntime-cro07:35:000
120429950,0cyclictest23351-21kworker/0:008:00:210
120569944,0cyclictest12316-21kworker/3:307:39:163
120569944,0cyclictest10373-21kworker/3:011:45:353
120569944,0cyclictest0-21swapper/310:00:033
120569943,1cyclictest18548-21diskstats08:25:143
120569941,3cyclictest15552-21apt-get08:20:133
120569941,3cyclictest0-21swapper/309:13:243
120569940,4cyclictest19355-21ssh09:30:573
120569940,4cyclictest11861-21ntp_states08:10:253
120569940,4cyclictest10986-21munin-run10:00:013
120569940,4cyclictest0-21swapper/312:35:113
120569940,4cyclictest0-21swapper/312:30:133
120569940,4cyclictest0-21swapper/312:30:133
120569940,4cyclictest0-21swapper/312:25:483
120569940,4cyclictest0-21swapper/312:20:113
120569940,4cyclictest0-21swapper/312:10:123
120569940,4cyclictest0-21swapper/311:55:133
120569940,4cyclictest0-21swapper/311:34:133
120569940,4cyclictest0-21swapper/311:10:133
120569940,4cyclictest0-21swapper/311:00:113
120569940,4cyclictest0-21swapper/310:27:043
120569940,4cyclictest0-21swapper/310:20:133
120569940,4cyclictest0-21swapper/310:15:443
120569940,4cyclictest0-21swapper/309:45:143
120569940,4cyclictest0-21swapper/309:35:133
120569940,4cyclictest0-21swapper/309:15:133
120569940,4cyclictest0-21swapper/309:05:133
120569940,4cyclictest0-21swapper/308:45:123
120569940,4cyclictest0-21swapper/308:35:123
120569940,4cyclictest0-21swapper/307:55:123
120569940,3cyclictest8038-21diskmemload09:43:123
120569940,3cyclictest310632sleep312:03:273
120569940,3cyclictest28303-21ssh10:08:223
120569940,3cyclictest28094-21latency_hist08:45:013
120569940,3cyclictest2728-21ssh10:44:293
120569940,3cyclictest20158-21ssh10:52:533
120569940,3cyclictest17707-21memory10:35:163
120569940,3cyclictest10288-21date08:10:003
120569940,3cyclictest0-21swapper/311:29:543
120569940,3cyclictest0-21swapper/307:25:123
120519944,0cyclictest0-21swapper/211:54:202
120519944,0cyclictest0-21swapper/211:02:062
120519944,0cyclictest0-21swapper/210:25:172
120519944,0cyclictest0-21swapper/209:15:532
120519944,0cyclictest0-21swapper/208:55:132
120519943,1cyclictest4367-21grep10:45:132
120519942,2cyclictest55950irq/130-eth012:03:432
120519941,2cyclictest0-21swapper/208:40:082
120519941,2cyclictest0-21swapper/207:25:132
120519941,1cyclictest714-21snmpd12:21:252
120519941,1cyclictest269832sh12:17:432
120519940,4cyclictest3501-21unixbench_singl09:55:192
120519940,4cyclictest3130-21rm11:32:492
120519940,4cyclictest26544-21cut10:40:132
120519940,4cyclictest190112sleep211:57:012
120519940,4cyclictest0-21swapper/211:40:112
120519940,4cyclictest0-21swapper/211:35:122
120519940,4cyclictest0-21swapper/210:30:142
120519940,4cyclictest0-21swapper/208:39:462
120519940,4cyclictest0-21swapper/208:30:132
120519940,4cyclictest0-21swapper/207:40:592
120519940,3cyclictest7881-21date08:05:012
120519940,3cyclictest4388-21gunzip07:55:192
120519940,3cyclictest4200-21sed09:00:162
120519940,3cyclictest32715-21sh09:54:342
120519940,3cyclictest30901-21latency_hist10:10:012
120519940,3cyclictest27117-21users07:35:232
120519940,3cyclictest19333-21ssh11:25:022
120519940,3cyclictest1598-21ssh12:05:112
120519940,3cyclictest15386-21sh11:22:402
120519940,3cyclictest15349-21hddtemp_smartct07:15:012
120519940,3cyclictest10740-21sh09:10:262
120519940,3cyclictest0-21swapper/208:15:142
120519940,2cyclictest22290-21ssh09:32:472
120519940,1cyclictest26455-21tr09:35:122
120519940,1cyclictest19005-21/usr/sbin/munin10:20:162
120519940,1cyclictest17865-21/usr/sbin/munin07:20:202
120519940,1cyclictest17073-21diskstats10:35:142
120519940,1cyclictest13958-21/usr/sbin/munin09:45:202
120519940,1cyclictest0-21swapper/211:45:122
120519940,0cyclictest0-21swapper/212:35:192
120469944,0cyclictest0-21swapper/111:48:311
120469944,0cyclictest0-21swapper/110:29:311
120469944,0cyclictest0-21swapper/109:15:181
120469942,1cyclictest0-21swapper/110:50:141
120469941,2cyclictest0-21swapper/112:10:111
120469941,2cyclictest0-21swapper/111:20:011
120469941,2cyclictest0-21swapper/110:14:561
120469941,2cyclictest0-21swapper/110:00:121
120469941,1cyclictest0-21swapper/109:25:151
120469940,4cyclictest0-21swapper/111:00:311
120469940,4cyclictest0-21swapper/110:16:521
120469940,2cyclictest0-21swapper/110:20:131
120469940,0cyclictest0-21swapper/111:38:121
120469940,0cyclictest0-21swapper/111:08:401
120429941,3cyclictest23351-21kworker/0:007:45:140
120429941,3cyclictest1453-21awk07:50:150
120429940,4cyclictest0-21swapper/009:05:020
120429940,4cyclictest0-21swapper/008:40:090
120429940,4cyclictest0-21swapper/008:20:130
120429940,3cyclictest20245-21latency_hist07:25:010
120569932,1cyclictest714-21snmpd09:00:073
120569931,2cyclictest0-21swapper/311:40:093
120569931,1cyclictest0-21swapper/312:15:123
120569930,3cyclictest6305-21ssh09:25:133
120569930,3cyclictest23863-21ssh10:55:053
120569930,3cyclictest1048-21ls08:55:133
120569930,3cyclictest1006-21diskstats07:50:133
120569930,3cyclictest0-21swapper/311:05:033
120569930,3cyclictest0-21swapper/309:50:083
120569930,3cyclictest0-21swapper/308:50:013
120569930,3cyclictest0-21swapper/308:30:003
120569930,3cyclictest0-21swapper/308:15:133
120569930,3cyclictest0-21swapper/308:00:123
120569930,3cyclictest0-21swapper/307:45:133
120569930,3cyclictest0-21swapper/307:30:103
120569930,3cyclictest0-21swapper/307:20:133
120569930,1cyclictest6258-21ssh10:30:033
120519933,0cyclictest31-21ksoftirqd/211:15:002
120519932,1cyclictest714-21snmpd07:45:072
120519931,2cyclictest0-21swapper/210:10:022
120519931,1cyclictest11433-21ssh11:05:032
120519930,3cyclictest29386-21ntp_states08:45:182
120519930,3cyclictest291rcuc/208:20:152
120519930,3cyclictest22795-21/usr/sbin/munin07:30:122
120519930,3cyclictest18545-21df_inode08:25:132
120519930,3cyclictest0-21swapper/212:25:032
120519930,3cyclictest0-21swapper/210:55:132
120519930,3cyclictest0-21swapper/209:05:012
120519930,3cyclictest0-21swapper/208:50:122
120519930,3cyclictest0-21swapper/208:10:002
120519930,3cyclictest0-21swapper/208:05:132
120519930,3cyclictest0-21swapper/207:50:112
120519930,3cyclictest0-21swapper/207:10:132
120519930,1cyclictest3689-21ssh09:40:042
120469933,0cyclictest0-21swapper/110:41:181
120469933,0cyclictest0-21swapper/109:43:581
120469932,1cyclictest0-21swapper/109:50:151
120469932,0cyclictest54382sleep108:00:131
120469931,1cyclictest244742chrt11:27:051
120469931,1cyclictest175822chrt07:19:521
120469931,1cyclictest0-21swapper/112:00:151
120469931,1cyclictest0-21swapper/111:55:141
120469931,1cyclictest0-21swapper/111:30:121
120469931,1cyclictest0-21swapper/110:55:121
120469931,1cyclictest0-21swapper/109:45:141
120469931,1cyclictest0-21swapper/108:55:131
120469931,1cyclictest0-21swapper/108:45:111
120469931,1cyclictest0-21swapper/108:15:121
120469931,1cyclictest0-21swapper/108:05:131
120469931,1cyclictest0-21swapper/107:55:121
120469931,1cyclictest0-21swapper/107:50:101
120469931,1cyclictest0-21swapper/107:45:131
120469931,1cyclictest0-21swapper/107:35:131
120469930,3cyclictest0-21swapper/108:11:341
120469930,2cyclictest0-21swapper/112:25:111
120469930,2cyclictest0-21swapper/111:50:131
120469930,2cyclictest0-21swapper/107:40:131
120469930,2cyclictest0-21swapper/107:10:131
120429931,1cyclictest0-21swapper/008:15:130
120429930,3cyclictest0-21swapper/009:00:080
120429930,3cyclictest0-21swapper/008:55:120
120429930,3cyclictest0-21swapper/008:30:130
120429930,3cyclictest0-21swapper/008:10:010
120429930,3cyclictest0-21swapper/007:10:040
120469921,1cyclictest222412chrt07:26:011
120469921,1cyclictest0-21swapper/110:45:121
120469921,1cyclictest0-21swapper/109:20:151
120469921,1cyclictest0-21swapper/109:05:021
120469921,1cyclictest0-21swapper/108:30:131
120469921,1cyclictest0-21swapper/108:25:121
120469921,0cyclictest0-21swapper/109:30:101
120469920,1cyclictest0-21swapper/111:40:121
120469920,1cyclictest0-21swapper/110:35:011
120469920,1cyclictest0-21swapper/110:05:111
120469920,1cyclictest0-21swapper/109:35:131
120469920,1cyclictest0-21swapper/108:50:121
120469920,1cyclictest0-21swapper/108:40:091
120469920,1cyclictest0-21swapper/108:35:011
120469920,1cyclictest0-21swapper/107:30:111
120469920,1cyclictest0-21swapper/107:20:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional