You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-17 - 20:53
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Mon Nov 17, 2025 12:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
77462193176,12sleep30-21swapper/307:08:593
75122190175,11sleep00-21swapper/007:05:540
76302188170,12sleep10-21swapper/107:07:281
77352178160,13sleep20-21swapper/207:08:502
297912490,0sleep10-21swapper/111:48:361
248202470,0sleep20-21swapper/207:40:202
234252430,0sleep10-21swapper/111:12:371
48332410,0sleep34835-21gltestperf09:10:163
294332400,0sleep10-21swapper/108:55:161
211612110,1sleep1211ktimersoftd/112:33:391
80059992,2cyclictest0-21swapper/109:45:131
6668290,0sleep00-21swapper/011:04:350
32578270,0sleep20-21swapper/211:17:062
80109960,6cyclictest9241-21ntp_states10:00:212
80059962,3cyclictest0-21swapper/107:35:131
80059961,4cyclictest0-21swapper/107:45:151
80059961,3cyclictest0-21swapper/108:15:171
80059961,3cyclictest0-21swapper/107:50:141
80019960,3cyclictest5941-21munin-run08:10:000
80149955,0cyclictest17256-21kworker/3:111:03:493
80149954,1cyclictest31206-21ntp_states12:05:203
80149952,3cyclictest32173-21/usr/sbin/munin09:40:233
80149950,5cyclictest1019-21diskmemload11:34:193
80149950,5cyclictest0-21swapper/311:18:553
80149950,1cyclictest21865-21ssh10:23:123
80109955,0cyclictest0-21swapper/212:27:112
80109955,0cyclictest0-21swapper/211:48:452
80109954,1cyclictest1866-21ntp_states10:45:202
80109950,5cyclictest0-21swapper/212:06:312
80109950,5cyclictest0-21swapper/211:57:382
80109950,5cyclictest0-21swapper/210:25:312
80109950,5cyclictest0-21swapper/209:45:492
80109950,5cyclictest0-21swapper/209:10:132
80109950,4cyclictest5849-21df_inode10:15:172
80059952,2cyclictest0-21swapper/111:50:131
80059952,2cyclictest0-21swapper/110:10:151
80059952,2cyclictest0-21swapper/108:35:141
80059951,3cyclictest0-21swapper/112:20:131
80059951,3cyclictest0-21swapper/109:50:131
80059951,2cyclictest0-21swapper/112:00:121
80059951,2cyclictest0-21swapper/111:25:131
80059951,2cyclictest0-21swapper/110:30:121
80059951,2cyclictest0-21swapper/110:20:131
80059951,2cyclictest0-21swapper/110:15:151
80059951,2cyclictest0-21swapper/108:40:121
80059951,2cyclictest0-21swapper/108:25:121
80059951,2cyclictest0-21swapper/108:25:121
80059951,2cyclictest0-21swapper/107:15:131
80059951,2cyclictest0-21swapper/107:10:131
80059950,5cyclictest0-21swapper/111:58:401
80059950,5cyclictest0-21swapper/110:43:531
80059950,5cyclictest0-21swapper/109:58:471
80059950,5cyclictest0-21swapper/109:31:171
80019955,0cyclictest0-21swapper/011:37:020
80019950,5cyclictest0-21swapper/011:46:390
80019950,5cyclictest0-21swapper/009:55:020
80019950,5cyclictest0-21swapper/009:08:370
80019950,0cyclictest0-21swapper/011:17:410
80149944,0cyclictest18332-21kworker/3:011:59:483
80149944,0cyclictest0-21swapper/311:37:423
80149943,1cyclictest3695-21/usr/sbin/munin08:05:183
80149943,1cyclictest23013-21gltestperf09:35:163
80149943,1cyclictest225-21systemd-journal08:25:013
80149943,1cyclictest19814-21/usr/sbin/munin09:50:153
80149941,1cyclictest0-21swapper/308:30:123
80149940,4cyclictest8672-21perl11:05:163
80149940,4cyclictest8645-21/usr/sbin/munin08:15:243
80149940,4cyclictest28531-21perl10:10:193
80149940,4cyclictest14313-21cut12:30:163
80149940,4cyclictest0-21swapper/310:45:213
80149940,4cyclictest0-21swapper/310:30:103
80149940,4cyclictest0-21swapper/310:05:163
80149940,4cyclictest0-21swapper/309:55:003
80149940,4cyclictest0-21swapper/308:35:133
80149940,4cyclictest0-21swapper/308:00:133
80149940,3cyclictest4815-21sh09:25:483
80149940,3cyclictest26169-21cat07:45:003
80149940,3cyclictest25893-21latency_hist08:50:013
80149940,3cyclictest24144-21sh12:18:393
80149940,3cyclictest22431-21sh11:45:023
80149940,3cyclictest13856-21apt-key09:15:013
80149940,3cyclictest13811-21cat07:20:003
80149940,3cyclictest11625-21seq10:50:173
80149940,2cyclictest21492-21ssh10:55:193
80149940,1cyclictest8118-21/usr/sbin/munin07:10:153
80149940,1cyclictest765-21fschecks_count11:50:163
80149940,1cyclictest4179-21/usr/sbin/munin12:25:193
80149940,1cyclictest20431-21df_inode12:00:153
80149940,1cyclictest18788-21/usr/sbin/munin07:30:153
80149940,1cyclictest16760-21cstates07:25:153
80149940,1cyclictest13661-21cut08:25:143
80149940,1cyclictest13661-21cut08:25:143
80149940,1cyclictest12987-21hwlatdetect09:30:153
80149940,0cyclictest0-21swapper/310:15:303
80109944,0cyclictest0-21swapper/210:35:262
80109944,0cyclictest0-21swapper/208:50:042
80109944,0cyclictest0-21swapper/207:15:392
80109943,1cyclictest6271-21ssh11:52:582
80109943,1cyclictest6240-21ssh10:31:122
80109943,1cyclictest29811-21ssh12:20:582
80109943,1cyclictest25811-21ntpq09:20:222
80109943,1cyclictest25110-21ssh11:30:112
80109942,2cyclictest4067-21cstates08:05:152
80109942,1cyclictest714-21snmpd09:09:122
80109942,1cyclictest31-21ksoftirqd/209:15:002
80109940,4cyclictest32017-21ssh09:40:062
80109940,4cyclictest21259-21apt-get07:35:132
80109940,4cyclictest17816-21apt-get10:05:152
80109940,4cyclictest0-21swapper/212:35:162
80109940,4cyclictest0-21swapper/212:15:532
80109940,4cyclictest0-21swapper/212:10:142
80109940,4cyclictest0-21swapper/212:00:132
80109940,4cyclictest0-21swapper/211:40:132
80109940,4cyclictest0-21swapper/211:35:132
80109940,4cyclictest0-21swapper/211:25:132
80109940,4cyclictest0-21swapper/211:10:122
80109940,4cyclictest0-21swapper/211:05:112
80109940,4cyclictest0-21swapper/211:01:002
80109940,4cyclictest0-21swapper/210:42:522
80109940,4cyclictest0-21swapper/210:21:102
80109940,4cyclictest0-21swapper/210:12:382
80109940,4cyclictest0-21swapper/209:55:162
80109940,4cyclictest0-21swapper/209:50:142
80109940,4cyclictest0-21swapper/209:35:012
80109940,4cyclictest0-21swapper/209:31:282
80109940,4cyclictest0-21swapper/209:25:142
80109940,4cyclictest0-21swapper/208:28:242
80109940,4cyclictest0-21swapper/208:28:232
80109940,4cyclictest0-21swapper/208:15:162
80109940,4cyclictest0-21swapper/208:03:482
80109940,3cyclictest26750-21/usr/sbin/munin07:45:162
80109940,3cyclictest21222-21tail10:55:162
80109940,3cyclictest17250-21rm12:31:082
80109940,3cyclictest13109-21rm10:50:452
80109940,3cyclictest0-21swapper/207:35:002
80109940,1cyclictest16852-21head08:30:162
80059944,0cyclictest0-21swapper/111:23:021
80059941,2cyclictest0-21swapper/112:35:161
80059941,2cyclictest0-21swapper/111:40:131
80059941,2cyclictest0-21swapper/111:35:121
80059941,2cyclictest0-21swapper/111:15:151
80059941,2cyclictest0-21swapper/110:55:151
80059941,2cyclictest0-21swapper/110:50:141
80059941,2cyclictest0-21swapper/110:35:121
80059941,2cyclictest0-21swapper/110:05:161
80059941,2cyclictest0-21swapper/109:40:131
80059941,2cyclictest0-21swapper/109:25:131
80059941,2cyclictest0-21swapper/108:50:121
80059941,2cyclictest0-21swapper/108:30:131
80059941,2cyclictest0-21swapper/107:55:141
80059941,1cyclictest0-21swapper/112:25:121
80059940,4cyclictest0-21swapper/112:14:591
80059940,4cyclictest0-21swapper/111:03:311
80059940,2cyclictest0-21swapper/108:05:141
80019944,0cyclictest0-21swapper/012:03:390
80019944,0cyclictest0-21swapper/010:52:130
80019944,0cyclictest0-21swapper/010:13:230
80019944,0cyclictest0-21swapper/010:01:100
80019943,1cyclictest1472-21munin-run09:25:010
80019942,1cyclictest25817-21ssh10:40:560
80019941,3cyclictest3223-21diskmemload11:14:370
80019940,4cyclictest3223-21diskmemload09:50:130
80019940,4cyclictest27486-21mailstats08:50:200
80019940,4cyclictest0-21swapper/012:25:130
80019940,4cyclictest0-21swapper/012:10:130
80019940,4cyclictest0-21swapper/012:07:130
80019940,4cyclictest0-21swapper/011:55:220
80019940,4cyclictest0-21swapper/011:50:140
80019940,4cyclictest0-21swapper/011:40:120
80019940,4cyclictest0-21swapper/011:29:420
80019940,4cyclictest0-21swapper/011:22:520
80019940,4cyclictest0-21swapper/010:30:130
80019940,4cyclictest0-21swapper/010:16:050
80019940,4cyclictest0-21swapper/010:05:020
80019940,4cyclictest0-21swapper/009:45:140
80019940,4cyclictest0-21swapper/009:40:140
80019940,4cyclictest0-21swapper/009:30:120
80019940,4cyclictest0-21swapper/009:15:140
80019940,4cyclictest0-21swapper/007:35:130
80019940,3cyclictest28200-21cron08:55:000
80019940,3cyclictest27276-21ssh11:30:230
80019940,3cyclictest21298-21hddtemp_smartct10:55:180
80019940,3cyclictest17482-21sed11:10:000
80019940,3cyclictest16071-21apt08:30:120
80019940,3cyclictest10538-21cut07:15:000
80019940,3cyclictest10054-21cat10:50:000
80019940,1cyclictest647-21munin-run12:39:590
80019940,0cyclictest0-21swapper/009:36:000
80019940,0cyclictest0-21swapper/009:25:210
25516240,0sleep00-21swapper/012:19:340
13195240,0sleep30-21swapper/311:24:033
80149932,1cyclictest7752-21sh10:00:143
80149932,1cyclictest6825-21tune2fs08:10:143
80149932,1cyclictest26573-21cut08:50:153
80149932,1cyclictest1485-21cat09:05:153
80149932,1cyclictest0-21swapper/308:55:133
80149930,3cyclictest29408-21perl07:50:153
80149930,3cyclictest0-21swapper/312:35:033
80149930,3cyclictest0-21swapper/312:20:083
80149930,3cyclictest0-21swapper/312:10:113
80149930,3cyclictest0-21swapper/311:40:013
80149930,3cyclictest0-21swapper/311:25:103
80149930,3cyclictest0-21swapper/310:35:133
80149930,3cyclictest0-21swapper/310:25:133
80149930,3cyclictest0-21swapper/309:45:023
80149930,3cyclictest0-21swapper/309:00:143
80149930,3cyclictest0-21swapper/308:40:113
80149930,3cyclictest0-21swapper/307:55:153
80149930,3cyclictest0-21swapper/307:35:133
80149930,3cyclictest0-21swapper/307:20:123
80149930,1cyclictest22743-21ssh10:40:093
80149930,1cyclictest18356-21df_inode11:10:133
80149930,1cyclictest0-21swapper/309:20:023
80149930,1cyclictest0-21swapper/307:45:133
80109933,0cyclictest0-21swapper/209:00:072
80109932,1cyclictest8468-21cpuspeed_turbos07:10:142
80109932,1cyclictest714-21snmpd08:35:082
80109932,1cyclictest714-21snmpd08:10:082
80109932,1cyclictest5130-21ssh11:20:062
80109931,1cyclictest714-21snmpd07:55:072
80109931,1cyclictest16322-21apt-get07:25:132
80109930,3cyclictest21142-21wget08:40:122
80109930,3cyclictest14634-21head07:20:152
80109930,3cyclictest0-21swapper/208:55:052
80109930,3cyclictest0-21swapper/208:45:002
80109930,3cyclictest0-21swapper/208:20:142
80109930,3cyclictest0-21swapper/207:50:122
80059933,0cyclictest0-21swapper/111:34:571
80059931,2cyclictest0-21swapper/110:45:141
80059931,2cyclictest0-21swapper/108:45:141
80059931,1cyclictest0-21swapper/112:15:141
80059931,1cyclictest0-21swapper/112:05:161
80059931,1cyclictest0-21swapper/110:25:141
80059931,1cyclictest0-21swapper/110:00:161
80059931,1cyclictest0-21swapper/109:35:141
80059931,1cyclictest0-21swapper/109:20:151
80059931,1cyclictest0-21swapper/109:10:021
80059931,1cyclictest0-21swapper/108:20:151
80059931,1cyclictest0-21swapper/108:10:131
80059931,1cyclictest0-21swapper/108:00:121
80059931,1cyclictest0-21swapper/107:30:131
80059930,2cyclictest14030-21chrt11:07:561
80059930,2cyclictest0-21swapper/109:15:011
80059930,2cyclictest0-21swapper/109:05:151
80059930,2cyclictest0-21swapper/109:00:151
80059930,2cyclictest0-21swapper/107:25:141
80019932,1cyclictest21333-21cpuspeed_turbos08:40:130
80019931,2cyclictest714-21snmpd07:20:050
80019930,3cyclictest9171-21df_inode08:15:180
80019930,3cyclictest3223-21diskmemload12:20:010
80019930,3cyclictest19780-21/usr/sbin/munin07:30:180
80019930,3cyclictest16322-21apt-get07:25:140
80019930,3cyclictest16024-21perl10:20:150
80019930,3cyclictest1449-21tr08:00:140
80019930,3cyclictest13973-21ssh12:30:110
80019930,3cyclictest11066-21grep07:15:010
80019930,3cyclictest0-21swapper/010:35:020
80019930,3cyclictest0-21swapper/010:25:150
80019930,3cyclictest0-21swapper/009:10:020
80019930,3cyclictest0-21swapper/009:00:140
80019930,3cyclictest0-21swapper/008:45:140
80019930,3cyclictest0-21swapper/008:35:080
80019930,3cyclictest0-21swapper/008:25:130
80019930,3cyclictest0-21swapper/008:25:120
80019930,3cyclictest0-21swapper/008:20:150
80019930,3cyclictest0-21swapper/008:10:040
80019930,3cyclictest0-21swapper/007:55:150
80019930,3cyclictest0-21swapper/007:50:130
80019930,3cyclictest0-21swapper/007:45:050
80019930,3cyclictest0-21swapper/007:40:140
80059921,1cyclictest0-21swapper/107:40:141
80059920,1cyclictest0-21swapper/107:20:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional