You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-08-26 - 18:57
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot2.osadl.org (updated Tue Aug 26, 2025 12:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
169002201185,11sleep10-21swapper/107:07:161
167722188172,11sleep00-21swapper/007:05:340
170252185167,13sleep20-21swapper/207:08:532
167652184168,11sleep30-21swapper/307:05:293
100792450,0sleep10-21swapper/109:55:541
18552430,0sleep10-21swapper/112:02:291
78792410,0sleep20-21swapper/211:16:092
135582400,1sleep31732199cyclictest11:03:063
214272390,0sleep00-21swapper/011:23:290
100162160,0sleep10-21swapper/110:45:141
9961290,0sleep10-21swapper/109:00:211
6779290,0sleep10-21swapper/110:26:531
173169970,5cyclictest0-21swapper/211:30:132
173219965,1cyclictest0-21swapper/311:47:173
173219965,1cyclictest0-21swapper/311:47:173
173079962,2cyclictest0-21swapper/112:35:121
173049962,4cyclictest16594-21awk11:05:010
173049960,3cyclictest1344-21apt-get11:30:010
15435260,0sleep10-21swapper/109:42:491
28653250,0sleep10-21swapper/109:33:231
173219955,0cyclictest21507-21kworker/3:012:20:133
173219955,0cyclictest0-21swapper/310:46:273
173219950,5cyclictest0-21swapper/310:43:233
173219950,5cyclictest0-21swapper/310:25:483
173219950,5cyclictest0-21swapper/309:34:263
173219950,5cyclictest0-21swapper/308:25:183
173219950,4cyclictest23351-21apt-get07:20:153
173169950,5cyclictest0-21swapper/212:22:462
173169950,4cyclictest0-21swapper/208:40:122
173169950,3cyclictest0-21swapper/209:38:522
173169950,1cyclictest18962-21munin-run09:45:012
173079950,5cyclictest0-21swapper/111:12:181
173049955,0cyclictest3-21ksoftirqd/012:15:120
173049953,1cyclictest3-21ksoftirqd/009:20:140
173049952,3cyclictest30997-21snmpd11:07:480
173049950,5cyclictest0-21swapper/011:36:250
173049950,5cyclictest0-21swapper/011:19:410
173049950,5cyclictest0-21swapper/007:44:110
22669240,0sleep10-21swapper/110:35:171
173219944,0cyclictest21507-21kworker/3:011:35:253
173219944,0cyclictest21507-21kworker/3:010:50:403
173219944,0cyclictest0-21swapper/311:57:013
173219944,0cyclictest0-21swapper/309:20:453
173219943,1cyclictest23025-21grep08:25:013
173219941,3cyclictest29068-21if_eth408:35:163
173219941,2cyclictest0-21swapper/312:15:123
173219941,2cyclictest0-21swapper/310:30:183
173219941,2cyclictest0-21swapper/307:45:123
173219941,2cyclictest0-21swapper/307:25:113
173219941,2cyclictest0-21swapper/307:10:123
173219940,4cyclictest20651-21ssh12:11:563
173219940,4cyclictest13013-21diskmemload09:46:113
173219940,4cyclictest13013-21diskmemload09:15:133
173219940,4cyclictest0-21swapper/312:35:123
173219940,4cyclictest0-21swapper/312:25:013
173219940,4cyclictest0-21swapper/312:05:123
173219940,4cyclictest0-21swapper/312:03:353
173219940,4cyclictest0-21swapper/311:50:123
173219940,4cyclictest0-21swapper/311:25:123
173219940,4cyclictest0-21swapper/311:18:103
173219940,4cyclictest0-21swapper/311:05:113
173219940,4cyclictest0-21swapper/310:35:163
173219940,4cyclictest0-21swapper/310:15:163
173219940,4cyclictest0-21swapper/310:10:133
173219940,4cyclictest0-21swapper/310:02:403
173219940,4cyclictest0-21swapper/309:41:573
173219940,4cyclictest0-21swapper/308:45:113
173219940,4cyclictest0-21swapper/308:30:123
173219940,4cyclictest0-21swapper/307:40:123
173219940,3cyclictest9245-21irqstats07:55:163
173219940,3cyclictest8824-21diskstats09:00:143
173219940,3cyclictest3089-21ssh11:30:173
173219940,3cyclictest29671-21ssh10:55:133
173219940,3cyclictest28372-21memory10:05:183
173219940,3cyclictest22643-21ssh12:30:003
173219940,3cyclictest20325-21python07:15:013
173219940,3cyclictest16795-21memory08:10:183
173219940,3cyclictest13585-21ssh09:10:143
173219940,3cyclictest13013-21diskmemload10:20:013
173219940,3cyclictest10898-21apt-get09:25:013
173219940,3cyclictest0-21swapper/311:10:143
173219940,0cyclictest0-21swapper/311:42:463
173169944,0cyclictest0-21swapper/210:05:072
173169943,1cyclictest6516-21grep07:50:142
173169943,1cyclictest13178-21/usr/sbin/munin12:25:192
173169943,0cyclictest31-21ksoftirqd/208:50:012
173169942,2cyclictest0-21swapper/210:25:152
173169941,3cyclictest32714-21sh12:35:062
173169941,2cyclictest0-21swapper/207:25:122
173169941,1cyclictest11946-21sh11:02:052
173169940,4cyclictest3302-21apt-get08:50:012
173169940,4cyclictest30305-21perl09:50:142
173169940,4cyclictest0-21swapper/212:03:052
173169940,4cyclictest0-21swapper/211:51:412
173169940,4cyclictest0-21swapper/211:35:072
173169940,4cyclictest0-21swapper/210:50:122
173169940,4cyclictest0-21swapper/210:45:152
173169940,4cyclictest0-21swapper/210:38:262
173169940,4cyclictest0-21swapper/210:32:562
173169940,4cyclictest0-21swapper/210:20:542
173169940,4cyclictest0-21swapper/210:16:362
173169940,4cyclictest0-21swapper/210:00:042
173169940,4cyclictest0-21swapper/209:55:162
173169940,4cyclictest0-21swapper/209:15:132
173169940,4cyclictest0-21swapper/208:35:122
173169940,4cyclictest0-21swapper/208:01:542
173169940,4cyclictest0-21swapper/207:35:122
173169940,3cyclictest32645-21sh11:29:182
173169940,3cyclictest31784-21/usr/sbin/munin11:45:262
173169940,3cyclictest31784-21/usr/sbin/munin11:45:262
173169940,3cyclictest29671-21ssh10:55:132
173169940,3cyclictest28098-21ssh12:32:162
173169940,3cyclictest24617-21ntp_states07:20:202
173169940,3cyclictest22202-21python08:20:192
173169940,3cyclictest20379-21hddtemp_smartct09:45:152
173169940,3cyclictest20113-21cut07:15:012
173169940,3cyclictest18680-21sh11:55:012
173169940,3cyclictest1693-21sh12:19:172
173169940,3cyclictest16198-21/usr/sbin/munin12:10:212
173169940,3cyclictest11226-21cat09:25:002
173169940,3cyclictest10532-21latency_hist09:05:012
173169940,3cyclictest0-21swapper/207:40:122
173169940,1cyclictest8253-21/usr/sbin/munin07:55:142
173169940,0cyclictest0-21swapper/211:05:392
173169940,0cyclictest0-21swapper/210:44:152
173079944,0cyclictest0-21swapper/111:42:521
173079944,0cyclictest0-21swapper/110:04:381
173079944,0cyclictest0-21swapper/109:36:081
173079944,0cyclictest0-21swapper/109:11:411
173079941,2cyclictest0-21swapper/112:05:121
173079941,2cyclictest0-21swapper/111:45:161
173079941,2cyclictest0-21swapper/111:45:151
173079941,2cyclictest0-21swapper/111:00:161
173079941,2cyclictest0-21swapper/110:40:131
173079941,2cyclictest0-21swapper/110:10:131
173079941,2cyclictest0-21swapper/109:15:131
173079941,2cyclictest0-21swapper/109:05:161
173079941,2cyclictest0-21swapper/108:20:121
173079941,2cyclictest0-21swapper/107:55:131
173079941,2cyclictest0-21swapper/107:50:121
173079941,2cyclictest0-21swapper/107:15:151
173079941,2cyclictest0-21swapper/107:10:121
173079941,1cyclictest0-21swapper/109:45:121
173079940,4cyclictest0-21swapper/111:58:431
173079940,4cyclictest0-21swapper/107:45:061
173079940,2cyclictest0-21swapper/110:55:121
173079940,2cyclictest0-21swapper/108:40:121
173079940,0cyclictest0-21swapper/110:22:241
173049944,0cyclictest0-21swapper/011:13:350
173049944,0cyclictest0-21swapper/010:23:050
173049944,0cyclictest0-21swapper/007:54:130
173049942,2cyclictest41ktimersoftd/010:15:230
173049942,2cyclictest25507-21ssh11:58:130
173049942,1cyclictest0-21swapper/008:59:560
173049941,3cyclictest8682-21ssh10:11:330
173049941,1cyclictest81rcu_preempt08:45:100
173049941,1cyclictest0-21swapper/012:25:110
173049940,4cyclictest24416-21perl09:15:150
173049940,4cyclictest13013-21diskmemload10:55:040
173049940,4cyclictest0-21swapper/012:20:170
173049940,4cyclictest0-21swapper/012:00:120
173049940,4cyclictest0-21swapper/011:50:120
173049940,4cyclictest0-21swapper/011:40:120
173049940,4cyclictest0-21swapper/010:08:300
173049940,4cyclictest0-21swapper/010:00:130
173049940,4cyclictest0-21swapper/009:35:130
173049940,4cyclictest0-21swapper/009:33:110
173049940,4cyclictest0-21swapper/009:10:200
173049940,4cyclictest0-21swapper/008:35:120
173049940,4cyclictest0-21swapper/007:35:130
173049940,4cyclictest0-21swapper/007:30:110
173049940,3cyclictest9095-21ssh09:40:000
173049940,3cyclictest8899-21/usr/sbin/munin09:55:230
173049940,3cyclictest880-21ssh10:40:170
173049940,3cyclictest5549-21cron08:55:010
173049940,3cyclictest377-21ssh12:35:120
173049940,3cyclictest28061-21latency_hist07:30:010
173049940,3cyclictest22309-21ssh10:50:410
173049940,3cyclictest20061-21munin-node07:15:010
173049940,3cyclictest18536-21if_eth007:10:160
173049940,3cyclictest17849-21ssh10:49:110
173049940,3cyclictest11452-21perl08:00:150
173049940,3cyclictest0-21swapper/009:00:120
173049940,3cyclictest0-21swapper/008:40:120
173049940,2cyclictest31760-21ssh11:45:150
173049940,2cyclictest31760-21ssh11:45:150
173049940,2cyclictest0-21swapper/010:31:080
173049940,2cyclictest0-21swapper/009:25:360
173049940,1cyclictest0-21swapper/011:33:000
173049940,0cyclictest0-21swapper/012:05:050
10544240,0sleep00-21swapper/010:29:170
173219933,0cyclictest0-21swapper/308:15:163
173219932,1cyclictest31043-21cat08:40:143
173219931,1cyclictest10769-21apt09:05:173
173219930,3cyclictest7564-21tr09:55:173
173219930,3cyclictest32053-21ls09:35:143
173219930,3cyclictest30809-21aten2_r5power_e07:35:133
173219930,3cyclictest28292-21apt-get07:30:113
173219930,3cyclictest13234-21dpkg08:05:143
173219930,3cyclictest11274-21df_inode08:00:143
173219930,3cyclictest0-21swapper/311:20:163
173219930,3cyclictest0-21swapper/309:50:053
173219930,3cyclictest0-21swapper/308:55:013
173219930,3cyclictest0-21swapper/308:50:003
173219930,3cyclictest0-21swapper/307:50:113
173169931,2cyclictest30997-21snmpd11:40:072
173169931,1cyclictest0-21swapper/209:05:172
173169930,3cyclictest6050-21ssh12:05:022
173169930,3cyclictest3838-21diskstats07:45:142
173169930,3cyclictest25627-21/usr/sbin/munin08:30:112
173169930,3cyclictest13267-21sh09:10:022
173169930,3cyclictest1219-21ssh09:20:082
173169930,3cyclictest0-21swapper/211:20:122
173169930,3cyclictest0-21swapper/211:10:142
173169930,3cyclictest0-21swapper/209:30:052
173169930,3cyclictest0-21swapper/208:55:132
173169930,3cyclictest0-21swapper/208:25:012
173169930,3cyclictest0-21swapper/208:15:152
173169930,3cyclictest0-21swapper/208:10:132
173169930,3cyclictest0-21swapper/208:05:002
173169930,3cyclictest0-21swapper/207:10:012
173169930,2cyclictest30997-21snmpd07:30:032
173169930,1cyclictest0-21swapper/210:10:082
173079933,0cyclictest0-21swapper/111:15:221
173079931,1cyclictest0-21swapper/112:30:161
173079931,1cyclictest0-21swapper/112:20:131
173079931,1cyclictest0-21swapper/112:10:161
173079931,1cyclictest0-21swapper/111:50:121
173079931,1cyclictest0-21swapper/111:30:131
173079931,1cyclictest0-21swapper/111:20:121
173079931,1cyclictest0-21swapper/111:05:111
173079931,1cyclictest0-21swapper/110:15:161
173079931,1cyclictest0-21swapper/110:05:141
173079931,1cyclictest0-21swapper/109:50:121
173079931,1cyclictest0-21swapper/109:20:141
173079931,1cyclictest0-21swapper/108:50:131
173079931,1cyclictest0-21swapper/108:30:121
173079931,1cyclictest0-21swapper/107:20:151
173079930,3cyclictest0-21swapper/108:56:581
173079930,3cyclictest0-21swapper/107:42:461
173079930,2cyclictest12673-21chrt08:01:081
173079930,2cyclictest0-21swapper/111:35:141
173079930,2cyclictest0-21swapper/110:30:171
173079930,2cyclictest0-21swapper/108:10:131
173049933,0cyclictest3-21ksoftirqd/009:45:120
173049931,2cyclictest23254-21aten2_r5power_v08:25:120
173049931,2cyclictest0-21swapper/012:10:140
173049930,3cyclictest8258-21dpkg07:55:130
173049930,3cyclictest32982sleep007:45:060
173049930,3cyclictest16230-21df_inode08:10:150
173049930,3cyclictest13413-21cat08:05:150
173049930,3cyclictest0-21swapper/012:30:030
173049930,3cyclictest0-21swapper/010:35:010
173049930,3cyclictest0-21swapper/009:50:120
173049930,3cyclictest0-21swapper/009:05:170
173049930,3cyclictest0-21swapper/008:30:120
173049930,3cyclictest0-21swapper/008:20:100
173049930,3cyclictest0-21swapper/008:15:150
173049930,3cyclictest0-21swapper/007:20:150
173079921,1cyclictest250272chrt08:25:301
173079921,1cyclictest0-21swapper/112:25:111
173079921,1cyclictest0-21swapper/110:50:171
173079921,1cyclictest0-21swapper/109:25:011
173079921,1cyclictest0-21swapper/108:15:151
173079921,1cyclictest0-21swapper/107:25:121
173079921,0cyclictest0-21swapper/108:05:141
173079921,0cyclictest0-21swapper/107:35:131
173079920,2cyclictest30039-21taskset08:36:231
173079920,2cyclictest0-21swapper/111:25:111
173079920,1cyclictest0-21swapper/112:15:121
173079920,1cyclictest0-21swapper/108:45:111
173079920,1cyclictest0-21swapper/107:30:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional