You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-11 - 16:59
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot2.osadl.org (updated Tue Nov 11, 2025 12:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
282852194175,13sleep10-21swapper/107:07:271
284702183165,13sleep00-21swapper/007:09:520
281902181164,12sleep30-21swapper/307:06:123
281322155138,12sleep20-21swapper/207:05:272
106162490,0sleep30-21swapper/312:16:043
16712480,0sleep00-21swapper/010:34:430
320092430,0sleep20-21swapper/209:45:132
33902420,0sleep10-21swapper/111:07:361
20972100,0sleep30-21swapper/311:23:223
6299290,0sleep10-21swapper/110:36:201
26550280,0sleep10-21swapper/109:58:371
23168280,0sleep00-21swapper/011:00:530
286659960,5cyclictest0-21swapper/308:45:173
286609960,5cyclictest20224-21ssh11:00:122
286659955,0cyclictest4114-21kworker/3:012:07:523
286659955,0cyclictest10836-21kworker/3:211:11:533
286659955,0cyclictest10836-21kworker/3:209:42:203
286659955,0cyclictest10836-21kworker/3:209:19:573
286659955,0cyclictest10836-21kworker/3:208:57:323
286659955,0cyclictest10836-21kworker/3:208:12:473
286659955,0cyclictest10836-21kworker/3:208:01:353
286659955,0cyclictest10836-21kworker/3:207:39:103
286659955,0cyclictest10836-21kworker/3:207:27:593
286659955,0cyclictest10836-21kworker/3:207:16:473
286659950,5cyclictest0-21swapper/311:47:383
286659950,5cyclictest0-21swapper/310:33:433
286659950,5cyclictest0-21swapper/309:25:103
286659950,4cyclictest19418-21users12:20:223
286659950,4cyclictest0-21swapper/310:40:143
286659950,3cyclictest5605-21ssh10:35:543
286659950,3cyclictest0-21swapper/311:32:443
286659950,0cyclictest0-21swapper/311:07:273
286609950,5cyclictest0-21swapper/211:17:032
286609950,0cyclictest10961-21ssh11:44:152
286569951,3cyclictest0-21swapper/107:25:121
286569951,2cyclictest0-21swapper/107:10:121
286569950,5cyclictest0-21swapper/111:37:571
286569950,5cyclictest0-21swapper/109:36:091
286559955,0cyclictest0-21swapper/011:43:090
286559950,5cyclictest0-21swapper/012:36:240
286559950,5cyclictest0-21swapper/010:42:450
286559950,5cyclictest0-21swapper/010:00:260
286559950,5cyclictest0-21swapper/008:40:410
286559950,0cyclictest0-21swapper/010:57:010
286559950,0cyclictest0-21swapper/010:57:010
22074250,0sleep10-21swapper/110:28:281
7593240,0sleep00-21swapper/011:10:070
31934240,0sleep0714-21snmpd10:17:030
31312240,0sleep00-21swapper/009:45:070
286659944,0cyclictest0-21swapper/311:41:303
286659944,0cyclictest0-21swapper/310:46:223
286659943,1cyclictest2291-21apt-get07:20:143
286659942,2cyclictest55950irq/130-eth012:10:333
286659942,1cyclictest714-21snmpd08:51:113
286659942,1cyclictest714-21snmpd08:39:533
286659942,1cyclictest714-21snmpd08:21:053
286659942,1cyclictest714-21snmpd07:33:353
286659942,1cyclictest16467-21ssh09:21:123
286659942,1cyclictest0-21swapper/310:50:133
286659941,3cyclictest714-21snmpd09:12:043
286659941,3cyclictest5283-21tune2fs08:30:143
286659941,2cyclictest0-21swapper/309:35:143
286659941,2cyclictest0-21swapper/308:15:143
286659940,4cyclictest18155-21cat11:15:143
286659940,4cyclictest12372-21apt-get07:40:013
286659940,4cyclictest0-21swapper/312:35:013
286659940,4cyclictest0-21swapper/312:30:363
286659940,4cyclictest0-21swapper/312:27:303
286659940,4cyclictest0-21swapper/312:00:113
286659940,4cyclictest0-21swapper/310:10:143
286659940,4cyclictest0-21swapper/310:01:003
286659940,4cyclictest0-21swapper/309:45:113
286659940,4cyclictest0-21swapper/308:25:143
286659940,3cyclictest7377-21ssh11:25:243
286659940,3cyclictest680-21df_inode11:55:143
286659940,3cyclictest28619-21sh11:36:133
286659940,3cyclictest27228-21/usr/sbin/munin10:15:163
286659940,3cyclictest25189-21sh11:02:113
286659940,3cyclictest23148-21df11:50:133
286659940,2cyclictest10082-21ssh10:55:073
286659940,2cyclictest10082-21ssh10:55:063
286659940,1cyclictest920-21/usr/sbin/munin09:30:163
286659940,1cyclictest5069-21/usr/sbin/munin10:20:213
286659940,1cyclictest22244-21/usr/sbin/munin09:05:143
286609944,0cyclictest0-21swapper/212:17:432
286609944,0cyclictest0-21swapper/211:57:132
286609944,0cyclictest0-21swapper/210:24:312
286609942,1cyclictest714-21snmpd11:49:002
286609942,1cyclictest714-21snmpd10:37:042
286609942,1cyclictest714-21snmpd07:37:532
286609941,3cyclictest10019-21ssh12:00:112
286609941,3cyclictest0-21swapper/211:10:162
286609940,4cyclictest8748-21python07:30:212
286609940,4cyclictest12151-21apt-get08:45:162
286609940,4cyclictest0-21swapper/212:38:272
286609940,4cyclictest0-21swapper/212:25:122
286609940,4cyclictest0-21swapper/212:20:012
286609940,4cyclictest0-21swapper/212:05:112
286609940,4cyclictest0-21swapper/211:50:132
286609940,4cyclictest0-21swapper/211:35:112
286609940,4cyclictest0-21swapper/211:25:142
286609940,4cyclictest0-21swapper/211:06:492
286609940,4cyclictest0-21swapper/210:55:152
286609940,4cyclictest0-21swapper/210:55:152
286609940,4cyclictest0-21swapper/210:52:142
286609940,4cyclictest0-21swapper/210:42:152
286609940,4cyclictest0-21swapper/210:30:132
286609940,4cyclictest0-21swapper/210:10:152
286609940,4cyclictest0-21swapper/210:05:122
286609940,4cyclictest0-21swapper/209:55:142
286609940,4cyclictest0-21swapper/209:40:132
286609940,4cyclictest0-21swapper/209:20:122
286609940,4cyclictest0-21swapper/209:05:132
286609940,4cyclictest0-21swapper/208:26:222
286609940,4cyclictest0-21swapper/208:03:222
286609940,3cyclictest3395-21ssh12:12:472
286609940,3cyclictest31031-21latency_hist07:15:012
286609940,3cyclictest30184-21rm11:20:362
286609940,3cyclictest23811-21ssh09:25:172
286609940,3cyclictest18158-21ssh10:25:592
286609940,3cyclictest14956-21rm11:30:032
286609940,3cyclictest0-21swapper/209:00:112
286609940,3cyclictest0-21swapper/207:45:132
286609940,2cyclictest0-21swapper/209:19:122
286609940,1cyclictest18774-21ssh09:38:542
286609940,0cyclictest0-21swapper/209:32:172
286569944,0cyclictest0-21swapper/112:33:321
286569944,0cyclictest0-21swapper/112:22:541
286569944,0cyclictest0-21swapper/112:13:001
286569944,0cyclictest0-21swapper/111:57:001
286569944,0cyclictest0-21swapper/111:53:561
286569944,0cyclictest0-21swapper/111:30:231
286569944,0cyclictest0-21swapper/107:40:191
286569941,2cyclictest0-21swapper/112:05:111
286569941,2cyclictest0-21swapper/111:20:131
286569941,2cyclictest0-21swapper/109:45:011
286569941,2cyclictest0-21swapper/109:30:151
286569941,2cyclictest0-21swapper/107:30:131
286569940,4cyclictest0-21swapper/110:07:001
286569940,1cyclictest0-21swapper/111:45:121
286569940,0cyclictest0-21swapper/112:00:041
286569940,0cyclictest0-21swapper/111:26:351
286559944,0cyclictest26358-21kworker/0:010:24:090
286559944,0cyclictest0-21swapper/012:15:090
286559944,0cyclictest0-21swapper/011:52:180
286559944,0cyclictest0-21swapper/010:53:150
286559942,2cyclictest26358-21kworker/0:011:27:170
286559942,2cyclictest26358-21kworker/0:007:13:490
286559941,3cyclictest17339-21ssh10:10:150
286559941,1cyclictest0-21swapper/011:30:120
286559940,4cyclictest21079-21ssh12:05:160
286559940,4cyclictest13537-21df09:20:140
286559940,4cyclictest0-21swapper/012:25:020
286559940,4cyclictest0-21swapper/012:23:280
286559940,4cyclictest0-21swapper/011:35:110
286559940,4cyclictest0-21swapper/011:05:140
286559940,4cyclictest0-21swapper/010:47:450
286559940,4cyclictest0-21swapper/010:35:290
286559940,4cyclictest0-21swapper/010:27:160
286559940,4cyclictest0-21swapper/009:56:450
286559940,4cyclictest0-21swapper/009:50:140
286559940,4cyclictest0-21swapper/009:32:560
286559940,3cyclictest7776-21perl10:05:140
286559940,3cyclictest493-21cat09:30:010
286559940,3cyclictest3517-21ntp_states08:25:200
286559940,3cyclictest3438-21diskstats09:15:170
286559940,3cyclictest2136-21gpgconf07:20:010
286559940,3cyclictest19167-21ntp_states11:15:200
286559940,3cyclictest18022-21perl07:50:150
286559940,3cyclictest1539-21ssh09:14:350
286559940,3cyclictest0-21swapper/009:40:190
286559940,3cyclictest0-21swapper/008:35:120
286559940,3cyclictest0-21swapper/007:40:010
286559940,1cyclictest722-21sed07:15:190
286559940,0cyclictest0-21swapper/011:55:220
31943230,0sleep10-21swapper/110:49:551
286659931,1cyclictest0-21swapper/309:00:113
286659931,1cyclictest0-21swapper/307:55:143
286659930,3cyclictest9682-21cut08:40:113
286659930,3cyclictest6758-21sh10:05:043
286659930,3cyclictest14839-21ssh10:25:033
286659930,3cyclictest0-21swapper/309:55:113
286659930,3cyclictest0-21swapper/308:05:123
286659930,3cyclictest0-21swapper/307:50:123
286659930,3cyclictest0-21swapper/307:45:023
286659930,3cyclictest0-21swapper/307:10:123
286659930,2cyclictest9072-21ssh09:50:093
286609932,1cyclictest714-21snmpd08:55:022
286609932,1cyclictest714-21snmpd08:35:022
286609932,1cyclictest5246-21diskstats08:30:142
286609932,1cyclictest29106-21ssh10:00:032
286609932,1cyclictest24753-21apt-get08:05:122
286609930,3cyclictest51272sleep207:25:132
286609930,3cyclictest4754-21ssh12:30:102
286609930,3cyclictest31315-21python07:15:012
286609930,3cyclictest27207-21ssh10:15:142
286609930,3cyclictest24785-21ssh09:10:042
286609930,3cyclictest0-21swapper/210:45:022
286609930,3cyclictest0-21swapper/209:50:032
286609930,3cyclictest0-21swapper/208:50:102
286609930,3cyclictest0-21swapper/208:40:112
286609930,3cyclictest0-21swapper/208:15:032
286609930,3cyclictest0-21swapper/208:10:132
286609930,3cyclictest0-21swapper/207:55:022
286609930,3cyclictest0-21swapper/207:50:122
286609930,3cyclictest0-21swapper/207:40:152
286609930,3cyclictest0-21swapper/207:20:012
286609930,1cyclictest32294-21cut08:20:132
286569931,2cyclictest0-21swapper/111:10:121
286569931,2cyclictest0-21swapper/108:30:131
286569931,2cyclictest0-21swapper/108:05:131
286569931,1cyclictest0-21swapper/112:35:011
286569931,1cyclictest0-21swapper/112:25:121
286569931,1cyclictest0-21swapper/112:15:111
286569931,1cyclictest0-21swapper/111:15:131
286569931,1cyclictest0-21swapper/111:00:121
286569931,1cyclictest0-21swapper/110:50:131
286569931,1cyclictest0-21swapper/110:30:131
286569931,1cyclictest0-21swapper/110:20:031
286569931,1cyclictest0-21swapper/110:15:161
286569931,1cyclictest0-21swapper/110:00:141
286569931,1cyclictest0-21swapper/109:25:151
286569931,1cyclictest0-21swapper/109:15:161
286569931,1cyclictest0-21swapper/109:05:131
286569931,1cyclictest0-21swapper/109:00:111
286569931,1cyclictest0-21swapper/108:45:161
286569931,1cyclictest0-21swapper/108:40:111
286569931,1cyclictest0-21swapper/108:25:141
286569931,1cyclictest0-21swapper/107:50:121
286569931,1cyclictest0-21swapper/107:35:131
286569930,3cyclictest0-21swapper/107:47:271
286569930,2cyclictest0-21swapper/110:40:141
286569930,2cyclictest0-21swapper/110:10:141
286569930,2cyclictest0-21swapper/109:20:121
286569930,2cyclictest0-21swapper/108:50:101
286569930,2cyclictest0-21swapper/107:20:131
286569930,2cyclictest0-21swapper/107:15:131
286559933,0cyclictest23115-21kworker/0:212:30:040
286559932,1cyclictest714-21snmpd08:30:080
286559932,1cyclictest14852-21taskset07:45:110
286559932,1cyclictest11075-21ssh12:00:150
286559931,1cyclictest12151-21apt-get08:45:160
286559930,3cyclictest30534-21hddtemp_smartct08:15:170
286559930,3cyclictest27751-21df_inode08:10:140
286559930,3cyclictest27586-21ssh11:20:080
286559930,3cyclictest20294-21df09:00:130
286559930,3cyclictest17855-21grep08:55:140
286559930,3cyclictest15339-21df_inode08:50:110
286559930,3cyclictest12669-21apt-get11:45:120
286559930,3cyclictest10884-21ssh09:35:100
286559930,3cyclictest0-21swapper/012:10:120
286559930,3cyclictest0-21swapper/009:05:140
286559930,3cyclictest0-21swapper/008:20:120
286559930,3cyclictest0-21swapper/008:05:120
286559930,3cyclictest0-21swapper/008:00:120
286559930,3cyclictest0-21swapper/007:55:140
286559930,3cyclictest0-21swapper/007:35:010
286559930,3cyclictest0-21swapper/007:30:130
286559930,3cyclictest0-21swapper/007:25:120
286569921,1cyclictest172762chrt08:55:041
286569921,1cyclictest0-21swapper/108:10:131
286569921,1cyclictest0-21swapper/108:00:121
286569921,1cyclictest0-21swapper/107:55:141
286569920,1cyclictest24829-21chrt09:10:051
286569920,1cyclictest0-21swapper/111:40:131
286569920,1cyclictest0-21swapper/110:55:141
286569920,1cyclictest0-21swapper/110:55:141
286569920,1cyclictest0-21swapper/109:50:151
286569920,1cyclictest0-21swapper/109:40:131
286569920,1cyclictest0-21swapper/108:35:121
286569920,1cyclictest0-21swapper/108:20:121
286569920,1cyclictest0-21swapper/108:15:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional