You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-14 - 22:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack1slot1.osadl.org (updated Fri Nov 14, 2025 12:45:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
88772204154,25sleep30-21swapper/307:06:103
88512201162,26sleep20-21swapper/207:05:482
88502201164,24sleep10-21swapper/107:05:471
90432199160,26sleep00-21swapper/007:08:200
74612750,0sleep10-21swapper/111:28:581
51432640,0sleep10-21swapper/109:12:441
31312600,0sleep0101rcuc/010:36:540
238592150,0sleep30-21swapper/308:45:143
925499148,4cyclictest28-21ksoftirqd/208:00:002
255412140,0sleep00-21swapper/008:50:000
926299120,9cyclictest11619-21munin-node10:58:263
9254991210,1cyclictest28-21ksoftirqd/211:40:152
9254991210,1cyclictest28-21ksoftirqd/210:25:232
925499120,11cyclictest19110-21snmpd11:09:132
9249991211,1cyclictest9-21ksoftirqd/010:20:180
9249991211,1cyclictest9-21ksoftirqd/007:30:000
9249991210,1cyclictest9-21ksoftirqd/011:50:000
925499119,1cyclictest28-21ksoftirqd/207:35:002
924999113,4cyclictest11679-21perf07:15:000
924999113,4cyclictest11679-21perf07:15:000
924999112,6cyclictest7584-21/usr/sbin/munin10:00:170
9249991111,0cyclictest9-21ksoftirqd/010:55:200
9249991110,1cyclictest9-21ksoftirqd/011:30:010
177462110,0sleep02377-21diskmemload11:41:390
925499109,1cyclictest28-21ksoftirqd/211:20:172
925499109,1cyclictest28-21ksoftirqd/210:05:182
925499109,1cyclictest28-21ksoftirqd/210:00:162
925499108,1cyclictest28-21ksoftirqd/211:18:412
925499108,1cyclictest28-21ksoftirqd/210:10:142
925499108,1cyclictest28-21ksoftirqd/209:15:142
925499104,3cyclictest60950irq/123-eno111:56:462
925499100,5cyclictest20157-21/usr/sbin/munin11:45:192
925499100,1cyclictest2377-21diskmemload12:05:182
924999109,1cyclictest9-21ksoftirqd/012:10:010
924999109,1cyclictest9-21ksoftirqd/011:55:000
924999109,1cyclictest9-21ksoftirqd/010:20:000
924999108,1cyclictest9-21ksoftirqd/010:25:220
924999108,1cyclictest9-21ksoftirqd/010:15:010
924999107,2cyclictest9-21ksoftirqd/007:40:000
71332100,0sleep00-21swapper/012:12:440
48462100,0sleep30-21swapper/309:11:553
92629999,0cyclictest35-21ksoftirqd/310:20:143
92629990,3cyclictest0-21swapper/308:40:133
92549998,1cyclictest28-21ksoftirqd/211:30:262
92549998,1cyclictest28-21ksoftirqd/211:10:182
92549998,1cyclictest28-21ksoftirqd/210:55:182
92549998,1cyclictest28-21ksoftirqd/209:22:282
92549998,1cyclictest28-21ksoftirqd/208:10:002
92549998,1cyclictest28-21ksoftirqd/207:15:012
92549997,1cyclictest28-21ksoftirqd/212:10:132
92549997,1cyclictest28-21ksoftirqd/209:40:162
92549997,1cyclictest28-21ksoftirqd/209:25:142
92549997,1cyclictest28-21ksoftirqd/208:50:132
92549996,1cyclictest60950irq/123-eno112:15:112
92549994,3cyclictest824-21apt-get10:35:152
92549994,2cyclictest60950irq/123-eno109:51:212
92549993,3cyclictest254-21systemd-journal10:45:002
92509990,6cyclictest0-21swapper/110:30:121
92499999,0cyclictest9-21ksoftirqd/011:30:010
92499998,1cyclictest9-21ksoftirqd/011:40:000
92499998,1cyclictest9-21ksoftirqd/011:18:590
92499998,1cyclictest9-21ksoftirqd/008:00:000
92629986,1cyclictest19110-21snmpd11:45:573
92629986,1cyclictest19110-21snmpd11:36:053
92629986,1cyclictest19110-21snmpd11:00:373
92629986,1cyclictest19110-21snmpd08:18:173
92629985,2cyclictest19110-21snmpd11:24:023
92629984,3cyclictest24998-21sh12:36:533
92629982,2cyclictest2377-21diskmemload11:05:123
92629980,4cyclictest0-21swapper/312:13:173
92629980,4cyclictest0-21swapper/309:55:063
92629980,3cyclictest2233-21/usr/sbin/munin12:05:183
92549988,0cyclictest28-21ksoftirqd/210:20:002
92549987,1cyclictest28-21ksoftirqd/211:38:462
92549987,1cyclictest28-21ksoftirqd/210:50:222
92549987,1cyclictest28-21ksoftirqd/209:32:302
92549986,1cyclictest60950irq/123-eno109:45:182
92549986,1cyclictest28-21ksoftirqd/208:30:002
92549984,4cyclictest28-21ksoftirqd/211:25:182
92549980,1cyclictest254-21systemd-journal12:34:552
92499988,0cyclictest9-21ksoftirqd/012:00:160
92499988,0cyclictest9-21ksoftirqd/009:30:140
92499987,1cyclictest9-21ksoftirqd/010:45:590
92499987,1cyclictest9-21ksoftirqd/010:40:150
92499987,1cyclictest9-21ksoftirqd/009:15:150
92499987,1cyclictest9-21ksoftirqd/009:00:000
92499987,1cyclictest9-21ksoftirqd/008:10:000
92499982,3cyclictest2377-21diskmemload09:42:460
92499981,6cyclictest20191-21ssh12:30:170
92499980,7cyclictest25474-21ssh11:09:020
92499980,7cyclictest16258-21ssh09:26:320
92629977,0cyclictest35-21ksoftirqd/309:31:153
92629977,0cyclictest0-21swapper/311:56:503
92629976,1cyclictest19110-21snmpd11:14:013
92629975,1cyclictest30259-21/usr/sbin/munin07:50:183
92629975,1cyclictest2377-21diskmemload10:52:013
92629975,1cyclictest1950-21ssh09:50:203
92629975,1cyclictest19110-21snmpd10:31:393
92629975,1cyclictest19110-21snmpd10:02:263
92629975,1cyclictest19110-21snmpd09:15:313
92629975,1cyclictest19110-21snmpd07:39:163
92629975,1cyclictest1742-21cat10:35:193
92629975,1cyclictest12671-21cat12:20:173
92629974,2cyclictest0-21swapper/307:15:123
92629970,6cyclictest17383-21ssh12:26:063
92629970,4cyclictest19110-21snmpd12:30:433
92549977,0cyclictest28-21ksoftirqd/209:36:392
92549977,0cyclictest28-21ksoftirqd/209:36:392
92549976,1cyclictest60950irq/123-eno112:20:162
92549976,1cyclictest60950irq/123-eno111:02:382
92549976,1cyclictest60950irq/123-eno110:32:422
92549976,1cyclictest60950irq/123-eno110:15:162
92549976,1cyclictest60950irq/123-eno109:56:552
92549976,1cyclictest28-21ksoftirqd/211:50:122
92549976,1cyclictest28-21ksoftirqd/210:45:162
92549976,1cyclictest28-21ksoftirqd/209:05:122
92549975,1cyclictest60950irq/123-eno107:30:002
92549975,1cyclictest28-21ksoftirqd/208:55:142
92549975,1cyclictest28-21ksoftirqd/208:30:132
92549975,1cyclictest28-21ksoftirqd/208:10:152
92549975,1cyclictest28-21ksoftirqd/207:20:142
92549975,1cyclictest19110-21snmpd09:11:192
92549973,4cyclictest0-21swapper/207:54:332
92549973,1cyclictest2377-21diskmemload12:01:022
92509971,3cyclictest0-21swapper/109:29:391
92509971,2cyclictest0-21swapper/109:20:131
92509970,6cyclictest0-21swapper/111:11:551
92509970,6cyclictest0-21swapper/110:14:511
92509970,4cyclictest0-21swapper/110:09:551
92509970,3cyclictest0-21swapper/109:17:021
92509970,0cyclictest0-21swapper/111:20:111
92499976,1cyclictest9-21ksoftirqd/010:05:120
92499976,1cyclictest9-21ksoftirqd/008:05:000
92499976,1cyclictest9-21ksoftirqd/007:50:000
92499976,1cyclictest19110-21snmpd08:19:530
92499975,1cyclictest9-21ksoftirqd/008:40:000
92499975,1cyclictest9-21ksoftirqd/007:55:000
92499972,1cyclictest11419-21/usr/sbin/munin08:20:190
92499971,6cyclictest10166-21ssh09:20:020
92499971,5cyclictest29190-21/usr/sbin/munin09:45:210
92499970,7cyclictest0-21swapper/009:37:300
92499970,7cyclictest0-21swapper/009:37:290
92499970,6cyclictest3374-21ssh09:54:050
92499970,6cyclictest26758-21ntp_states08:50:210
92499970,6cyclictest2377-21diskmemload11:00:160
92499970,6cyclictest16034-21fschecks_time12:25:150
92499970,6cyclictest14742-21ssh12:24:020
92499970,6cyclictest0-21swapper/010:31:010
92499970,3cyclictest859-21/usr/sbin/munin11:20:140
92499970,1cyclictest4621-21ssh09:11:150
92499970,1cyclictest28153-21ssh11:55:400
92499970,1cyclictest26632-21ssh11:10:160
92499970,1cyclictest2377-21diskmemload09:56:420
92499970,1cyclictest22767-21tail12:35:130
92499970,1cyclictest13560-21ssh10:50:320
92499970,1cyclictest0-21swapper/012:19:460
7961270,0sleep10-21swapper/112:15:001
92629965,1cyclictest6738-21ssh11:26:433
92629965,1cyclictest32686-21ssh12:03:343
92629965,1cyclictest19110-21snmpd10:40:453
92629965,1cyclictest19110-21snmpd10:06:293
92629965,1cyclictest19110-21snmpd09:42:083
92629965,1cyclictest19110-21snmpd07:30:223
92629964,1cyclictest8133-21aten_r1power_cu11:30:163
92629964,1cyclictest742-21runrttasks12:15:283
92629964,1cyclictest2377-21diskmemload10:46:043
92629964,1cyclictest19110-21snmpd09:46:493
92629964,1cyclictest19110-21snmpd08:39:303
92629963,1cyclictest254-21systemd-journal11:15:003
92629961,1cyclictest2377-21diskmemload09:20:543
92629961,1cyclictest0-21swapper/311:40:193
92629961,0cyclictest2377-21diskmemload10:17:023
92629960,5cyclictest0-21swapper/308:20:133
92629960,4cyclictest0-21swapper/309:37:403
92629960,4cyclictest0-21swapper/309:37:403
92629960,3cyclictest0-21swapper/311:50:563
92629960,3cyclictest0-21swapper/310:10:533
92629960,3cyclictest0-21swapper/309:26:013
92629960,3cyclictest0-21swapper/308:50:163
92629960,2cyclictest0-21swapper/308:25:223
92629960,0cyclictest0-21swapper/310:26:503
92549966,0cyclictest60950irq/123-eno108:40:182
92549966,0cyclictest60950irq/123-eno108:24:032
92549966,0cyclictest60950irq/123-eno107:45:122
92549965,1cyclictest8611-21apt-get08:15:012
92549963,2cyclictest25745-21sed07:40:172
92549960,6cyclictest0-21swapper/208:00:112
92549960,5cyclictest0-21swapper/209:01:432
92549960,4cyclictest2377-21diskmemload12:25:132
92549960,3cyclictest0-21swapper/208:45:142
92549960,3cyclictest0-21swapper/207:30:162
92549960,1cyclictest0-21swapper/212:35:152
92549960,1cyclictest0-21swapper/207:12:152
92549960,1cyclictest0-21swapper/207:12:152
92509960,6cyclictest0-21swapper/112:34:581
92509960,6cyclictest0-21swapper/111:45:511
92509960,6cyclictest0-21swapper/111:01:581
92509960,6cyclictest0-21swapper/110:59:341
92509960,6cyclictest0-21swapper/110:21:341
92509960,6cyclictest0-21swapper/109:44:381
92509960,6cyclictest0-21swapper/109:09:401
92509960,6cyclictest0-21swapper/107:58:491
92509960,6cyclictest0-21swapper/107:35:161
92509960,6cyclictest0-21swapper/107:31:551
92509960,5cyclictest0-21swapper/108:15:021
92509960,5cyclictest0-21swapper/107:14:301
92509960,5cyclictest0-21swapper/107:14:301
92509960,4cyclictest0-21swapper/111:15:161
92509960,4cyclictest0-21swapper/110:35:221
92509960,4cyclictest0-21swapper/110:16:321
92509960,3cyclictest0-21swapper/112:05:361
92509960,3cyclictest0-21swapper/110:25:551
92509960,3cyclictest0-21swapper/109:50:121
92509960,3cyclictest0-21swapper/109:45:291
92509960,2cyclictest0-21swapper/112:36:051
92509960,2cyclictest0-21swapper/112:16:061
92509960,2cyclictest0-21swapper/109:35:211
92509960,2cyclictest0-21swapper/109:35:211
92509960,1cyclictest0-21swapper/110:45:151
92509960,1cyclictest0-21swapper/107:50:191
92509960,0cyclictest0-21swapper/111:56:291
92499965,1cyclictest19110-21snmpd09:05:070
92499960,6cyclictest0-21swapper/007:16:000
92499960,5cyclictest19606-21/usr/sbin/munin07:30:230
92499960,5cyclictest16051-21ntp_states07:20:180
92499960,3cyclictest0-21swapper/008:30:120
92499960,1cyclictest0-21swapper/008:25:200
92499960,0cyclictest0-21swapper/009:01:550
92499960,0cyclictest0-21swapper/007:44:160
92629954,1cyclictest31813-21apt-get07:55:123
92629954,1cyclictest19110-21snmpd07:11:313
92629954,1cyclictest19110-21snmpd07:11:303
92629953,1cyclictest30820-21df09:00:143
92629953,1cyclictest24543-21apt-get07:40:113
92629953,1cyclictest1767-21taskset08:00:113
92629952,2cyclictest16138-21apt-get08:30:123
92629951,2cyclictest27947-21apt08:55:133
92629950,5cyclictest0-21swapper/307:26:203
92549950,5cyclictest0-21swapper/208:39:202
92509952,2cyclictest17535-21chrt11:40:591
92509951,1cyclictest0-21swapper/112:22:041
92509951,1cyclictest0-21swapper/109:55:121
92509950,5cyclictest0-21swapper/111:32:411
92509950,5cyclictest0-21swapper/109:02:101
92509950,5cyclictest0-21swapper/108:47:271
92509950,5cyclictest0-21swapper/108:40:051
92509950,5cyclictest0-21swapper/108:07:541
92509950,4cyclictest0-21swapper/108:28:021
92509950,3cyclictest0-21swapper/110:00:121
92509950,3cyclictest0-21swapper/108:10:171
92509950,3cyclictest0-21swapper/107:18:451
92509950,2cyclictest0-21swapper/112:01:511
92509950,2cyclictest0-21swapper/111:50:201
92509950,2cyclictest0-21swapper/111:06:381
92509950,2cyclictest0-21swapper/110:50:171
92509950,2cyclictest0-21swapper/109:30:371
92509950,1cyclictest0-21swapper/112:25:181
92509950,1cyclictest0-21swapper/110:44:441
92509950,1cyclictest0-21swapper/108:35:211
92499954,1cyclictest19110-21snmpd08:13:590
92499950,0cyclictest0-21swapper/008:42:300
92629943,1cyclictest16059-21ntpq07:20:183
92629942,1cyclictest742-21runrttasks09:05:013
92629942,1cyclictest5327-21sed08:05:193
92629942,1cyclictest26897-21/usr/sbin/munin07:45:153
92629940,2cyclictest0-21swapper/308:10:003
92509943,1cyclictest26509-21chrt07:43:131
92509940,2cyclictest0-21swapper/111:35:151
92509940,2cyclictest0-21swapper/108:53:211
92509940,2cyclictest0-21swapper/107:45:131
92509940,2cyclictest0-21swapper/107:23:511
92509940,1cyclictest0-21swapper/108:20:151
92509940,0cyclictest0-21swapper/107:26:071
92509931,1cyclictest0-21swapper/108:55:121
92509931,1cyclictest0-21swapper/108:30:181
92509930,1cyclictest0-21swapper/108:00:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional