You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-28 - 20:32
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack2slot0.osadl.org (updated Fri Nov 28, 2025 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
863921010,1sleep02194299cyclictest11:31:100
107462990,0sleep12194899cyclictest12:00:151
107462990,0sleep12194899cyclictest12:00:141
243362830,0sleep30-21swapper/310:59:323
166352750,0sleep10-21swapper/109:39:401
287892730,0sleep00-21swapper/010:13:280
276262700,0sleep327619-21bash12:12:423
45192690,0sleep24521-21latency_hist07:45:002
234232680,1sleep323405-21rm09:47:473
245622650,0sleep00-21swapper/011:06:340
155012650,0sleep20-21swapper/211:21:142
327282630,0sleep10-21swapper/109:23:181
312542630,1sleep231252-21lspci10:27:512
216792610,0sleep30-21swapper/309:18:283
31912590,0sleep20-21swapper/212:02:562
31912590,0sleep20-21swapper/212:02:552
28702560,0sleep10-21swapper/111:30:301
215652560,0sleep321561-21bash11:21:553
163052550,0sleep316301-21lspci09:39:383
310652540,0sleep00-21swapper/010:03:030
196942540,0sleep2311rcuc/211:46:572
146972540,1sleep114698-21id10:04:511
72432530,0sleep20-21swapper/209:35:012
13972530,0sleep20-21swapper/210:10:212
121882520,2sleep32196099cyclictest11:08:493
10072520,0sleep20-21swapper/209:41:262
73852480,0sleep00-21swapper/011:20:150
70562470,0sleep30-21swapper/310:43:143
102722470,0sleep0111rcuc/009:13:390
195292440,1sleep119511-21bash12:11:481
191122430,2sleep12194899cyclictest11:50:291
2170724136,3sleep00-21swapper/007:08:160
156762390,0sleep20-21swapper/211:13:102
274992290,0sleep20-21swapper/211:33:152
218302286,7sleep20-21swapper/207:09:432
2161622715,7sleep30-21swapper/307:07:073
158352250,1sleep015831-21sshd09:46:520
2178222217,3sleep10-21swapper/107:09:141
57762200,0sleep20-21swapper/210:39:292
61862170,0sleep30-21swapper/309:34:543
318122170,0sleep30-21swapper/310:13:473
21948991715,1cyclictest2877-21lspci12:17:051
21942991716,0cyclictest27537-21lspci10:20:240
159782160,1sleep315981-21timerwakeupswit08:10:213
144692160,0sleep00-21swapper/012:11:140
306902150,0sleep10-21swapper/112:20:121
90852140,0sleep30-21swapper/309:57:053
90592140,0sleep10-21swapper/110:43:281
226922140,0sleep30-21swapper/311:18:063
266402130,1sleep226635-21bash10:55:582
242152130,0sleep10-21swapper/107:15:011
2196099130,12cyclictest28257-21lspci10:09:523
21954991311,1cyclictest20193-21lspci11:17:442
21954991311,1cyclictest14420-21grep12:39:542
21942991311,1cyclictest6341-21sshd11:27:240
61662120,0sleep00-21swapper/010:46:390
287972120,0sleep2311rcuc/207:25:112
2196099120,1cyclictest30309-21sshd11:48:113
2196099120,1cyclictest29243-21sshd11:37:023
2196099120,1cyclictest20399-21sshd09:21:513
2196099120,1cyclictest18227-21sshd11:28:423
2196099120,11cyclictest9303-21lspci09:53:313
2196099120,11cyclictest26520-21sshd10:02:313
2196099120,11cyclictest0-21swapper/309:29:423
21954991211,0cyclictest31967-21lspci12:20:182
21954991211,0cyclictest25098-21lspci11:54:482
21954991211,0cyclictest24031-21lspci11:25:482
21954991211,0cyclictest14660-21lspci12:11:162
21954991210,1cyclictest8610-21lspci09:49:532
2195499120,11cyclictest31025-21sshd09:59:342
2195499120,11cyclictest17075-21sshd10:22:542
2195499120,11cyclictest0-21swapper/210:06:232
21948991210,1cyclictest6517-21/usr/sbin/munin10:25:191
21948991210,1cyclictest619-17sedispatch09:12:081
21948991210,1cyclictest30768-21lspci09:55:491
21948991210,1cyclictest23233-21sshd11:58:081
21948991210,1cyclictest0-21swapper/111:17:091
2194899120,1cyclictest618-13audispd09:27:081
2194899120,1cyclictest0-21swapper/109:33:591
2194899120,0cyclictest0-21swapper/110:48:191
2194299120,1cyclictest0-21swapper/012:33:530
2194299120,1cyclictest0-21swapper/011:17:440
2194299120,11cyclictest646-21dbus-daemon11:12:530
2194299120,11cyclictest0-21swapper/009:39:130
21960991110,0cyclictest0-21swapper/311:41:113
2196099110,10cyclictest0-21swapper/311:10:023
2196099110,0cyclictest0-21swapper/311:55:513
21954991110,0cyclictest29287-21lspci12:27:192
2195499110,10cyclictest0-21swapper/211:38:542
2195499110,10cyclictest0-21swapper/209:17:242
2195499110,10cyclictest0-21swapper/209:14:332
2195499110,0cyclictest0-21swapper/211:57:432
2194899119,1cyclictest1045-21bash11:26:491
2194899119,1cyclictest0-21swapper/111:21:581
21948991110,0cyclictest0-21swapper/111:46:581
2194899110,10cyclictest17480-21sshd11:39:181
2194899110,10cyclictest0-21swapper/112:33:581
2194899110,10cyclictest0-21swapper/110:05:281
2194899110,0cyclictest0-21swapper/110:21:191
2194299119,1cyclictest27299-21sshd09:26:130
2194299119,1cyclictest12534-21latency10:15:130
2194299119,1cyclictest0-21swapper/012:37:230
21942991110,0cyclictest0-21swapper/011:43:240
21942991110,0cyclictest0-21swapper/010:27:540
2194299110,10cyclictest0-21swapper/010:41:230
2194299110,10cyclictest0-21swapper/009:52:130
2194299110,10cyclictest0-21swapper/008:45:130
2194299110,0cyclictest0-21swapper/011:46:530
213492110,2sleep12194899cyclictest12:08:311
2196099109,0cyclictest0-21swapper/312:26:023
2196099109,0cyclictest0-21swapper/312:19:413
2196099109,0cyclictest0-21swapper/312:07:013
2196099109,0cyclictest0-21swapper/311:52:223
2196099109,0cyclictest0-21swapper/311:33:313
2196099109,0cyclictest0-21swapper/310:52:513
2196099109,0cyclictest0-21swapper/310:45:223
2196099109,0cyclictest0-21swapper/307:15:013
2196099108,1cyclictest0-21swapper/310:35:523
2196099100,0cyclictest0-21swapper/311:04:323
2196099100,0cyclictest0-21swapper/309:41:123
2195499109,0cyclictest15437-21lspci09:35:482
2195499109,0cyclictest0-21swapper/210:48:342
2195499109,0cyclictest0-21swapper/209:08:542
2194899109,0cyclictest0-21swapper/110:18:381
2194899109,0cyclictest0-21swapper/109:44:091
2194899109,0cyclictest0-21swapper/109:09:191
2194899109,0cyclictest0-21swapper/108:04:281
2194899109,0cyclictest0-21swapper/107:30:271
2194899109,0cyclictest0-21swapper/107:30:271
2194899100,9cyclictest0-21swapper/108:46:281
2194299109,0cyclictest0-21swapper/011:54:330
2194299109,0cyclictest0-21swapper/009:57:040
2194299100,0cyclictest0-21swapper/011:58:040
219609998,0cyclictest0-21swapper/312:35:533
219609998,0cyclictest0-21swapper/309:11:113
219609997,1cyclictest8664-21grep12:03:323
219609997,1cyclictest8664-21grep12:03:313
219609997,1cyclictest11167-21sshd09:08:223
219549998,0cyclictest20652-21lspci09:25:272
219549998,0cyclictest0-21swapper/210:40:232
219549997,1cyclictest33-21ksoftirqd/212:15:112
219549997,1cyclictest33-21ksoftirqd/211:06:142
219549997,1cyclictest33-21ksoftirqd/210:03:492
219549997,1cyclictest12583-21lspci10:18:532
219489998,0cyclictest0-21swapper/111:07:281
219489998,0cyclictest0-21swapper/110:55:481
219489998,0cyclictest0-21swapper/109:17:491
219489998,0cyclictest0-21swapper/108:19:581
219489998,0cyclictest0-21swapper/107:23:271
219429998,0cyclictest2428-21lspci12:02:520
219429998,0cyclictest2428-21lspci12:02:510
219429998,0cyclictest0-21swapper/010:50:140
219429995,3cyclictest700-21gdbus09:18:390
219429990,8cyclictest23330-21sshd10:05:380
219609986,1cyclictest27822-21lspci10:20:273
219609986,1cyclictest1952-21lspci10:17:383
219549987,0cyclictest0-21swapper/208:55:132
219549987,0cyclictest0-21swapper/208:42:332
219549986,1cyclictest7447-21lspci09:20:262
219549986,1cyclictest33-21ksoftirqd/212:31:222
219549986,1cyclictest33-21ksoftirqd/212:05:032
219549986,1cyclictest33-21ksoftirqd/211:40:332
219549986,1cyclictest33-21ksoftirqd/209:52:082
219549986,1cyclictest31731-21lspci10:53:082
219489987,0cyclictest0-21swapper/112:37:281
219489987,0cyclictest0-21swapper/111:43:291
219489987,0cyclictest0-21swapper/111:01:591
219489986,1cyclictest25-21ksoftirqd/112:28:481
219489986,1cyclictest21357-21lspci09:54:541
219489985,2cyclictest649-21avahi-daemon11:11:531
219489985,2cyclictest649-21avahi-daemon09:47:281
219489980,1cyclictest14883-21grepconf.sh10:36:501
219429987,0cyclictest0-21swapper/012:05:430
219429986,1cyclictest27032-21lspci09:44:360
219429986,1cyclictest24036-21sshd10:30:330
219429986,1cyclictest22424-21sshd12:15:340
219429986,1cyclictest20379-21lspci11:02:340
19537280,1sleep0111rcuc/012:22:360
9554270,0sleep10-21swapper/110:14:571
219609974,2cyclictest700-21gdbus12:24:583
219609974,2cyclictest700-21gdbus10:31:143
219609974,2cyclictest649-21avahi-daemon10:25:583
219609974,2cyclictest2764-21sshd12:31:393
219549975,1cyclictest33-21ksoftirqd/210:30:212
219549973,1cyclictest30665-21sshd11:00:132
219489975,1cyclictest25-21ksoftirqd/110:50:081
219489970,1cyclictest22082-21bash10:30:211
219429976,0cyclictest0-21swapper/008:05:130
219429975,1cyclictest9-21ksoftirqd/012:27:160
219429975,1cyclictest9-21ksoftirqd/009:22:400
219429975,1cyclictest616-17auditd09:32:040
219429974,2cyclictest646-21dbus-daemon11:38:000
219429972,1cyclictest121rcu_preempt08:00:200
219609964,1cyclictest649-21avahi-daemon08:05:133
219609960,5cyclictest0-21swapper/309:01:123
219549964,1cyclictest33-21ksoftirqd/208:19:592
219549963,2cyclictest17299-21snmpd07:21:412
219549960,5cyclictest0-21swapper/208:09:322
219489964,1cyclictest684-21polkitd07:15:001
219489964,1cyclictest684-21polkitd07:15:001
219489963,2cyclictest30620-21grep07:30:011
219489960,5cyclictest0-21swapper/107:55:471
219429965,0cyclictest0-21swapper/009:08:240
219429964,1cyclictest21586-21sshd10:55:250
219429964,1cyclictest17299-21snmpd08:15:100
219429964,1cyclictest17299-21snmpd07:35:000
219429964,1cyclictest17299-21snmpd07:34:590
219429963,2cyclictest30214-21sshd10:35:010
219429960,5cyclictest28336-21sshd07:22:240
219429960,5cyclictest2259-21sshd08:57:250
219429960,5cyclictest0-21swapper/007:11:340
219429960,5cyclictest0-21swapper/007:11:330
4267253,1sleep117299-21snmpd09:01:561
219609953,1cyclictest945-21cat07:35:133
219609953,1cyclictest75550irq/24-eno1-rx-08:55:123
219609953,1cyclictest5042-21mii-tool07:45:153
219609953,1cyclictest22631-21cat07:10:153
219609953,1cyclictest22631-21cat07:10:143
219609953,1cyclictest21288-21cat08:25:133
219609953,1cyclictest17299-21snmpd08:50:083
219609953,1cyclictest17299-21snmpd08:43:233
219609953,1cyclictest17299-21snmpd08:35:023
219609953,1cyclictest17299-21snmpd08:30:133
219609953,1cyclictest17299-21snmpd08:24:313
219609953,1cyclictest17299-21snmpd08:17:003
219609953,1cyclictest17299-21snmpd07:55:073
219609953,1cyclictest17299-21snmpd07:42:473
219609953,1cyclictest17299-21snmpd07:33:153
219609953,1cyclictest17299-21snmpd07:33:143
219609953,1cyclictest17299-21snmpd07:28:213
219609953,1cyclictest11155-21cat08:00:133
219609952,2cyclictest27268-21cat07:20:143
219609950,4cyclictest30330-21grep08:45:193
219549954,0cyclictest0-21swapper/207:15:032
219549953,1cyclictest9653-21sendmail_mailqu07:55:152
219549953,1cyclictest6604-21/usr/sbin/munin07:50:162
219549953,1cyclictest29460-21cat08:45:132
219549953,1cyclictest17299-21snmpd09:00:412
219549953,1cyclictest17299-21snmpd08:26:352
219549953,1cyclictest17299-21snmpd08:13:432
219549953,1cyclictest17299-21snmpd08:00:162
219549953,1cyclictest17299-21snmpd07:46:512
219549953,1cyclictest17299-21snmpd07:10:112
219549953,1cyclictest17299-21snmpd07:10:102
219549953,1cyclictest1027-21sort07:35:152
219549953,1cyclictest0-21swapper/208:50:132
219549950,4cyclictest22875-21/usr/sbin/munin08:30:222
219549950,1cyclictest24905-21/usr/sbin/munin08:35:132
219549950,1cyclictest18807-21/usr/sbin/munin08:20:202
219489954,0cyclictest0-21swapper/108:43:191
219489954,0cyclictest0-21swapper/108:05:171
219489954,0cyclictest0-21swapper/107:51:271
219489953,1cyclictest31204-21expr08:50:121
219489953,1cyclictest2927-21hddtemp_smartct07:40:141
219489953,1cyclictest23018-21tr08:30:101
219489953,1cyclictest17299-21snmpd08:56:391
219489953,1cyclictest17299-21snmpd08:25:321
219489953,1cyclictest17299-21snmpd07:45:031
219489953,1cyclictest17299-21snmpd07:35:061
219489952,2cyclictest17299-21snmpd08:36:581
219489950,0cyclictest0-21swapper/108:12:181
219429954,0cyclictest0-21swapper/008:20:030
219429953,1cyclictest910-21cat07:35:140
219429953,1cyclictest5059-21cat07:45:150
219429953,1cyclictest31387-21hddtemp_smartct08:50:130
219429953,1cyclictest17299-21snmpd09:01:470
219429953,1cyclictest17299-21snmpd08:41:590
219429953,1cyclictest17299-21snmpd08:36:430
219429953,1cyclictest17299-21snmpd08:33:110
219429953,1cyclictest17299-21snmpd08:25:380
219429953,1cyclictest17299-21snmpd08:10:150
219429953,1cyclictest17299-21snmpd07:50:450
219429953,1cyclictest17299-21snmpd07:28:180
219429953,1cyclictest1058-21sendmail07:41:580
219429950,4cyclictest10428-21crond08:00:000
219609943,0cyclictest0-21swapper/307:50:013
219549942,1cyclictest30996-21expr07:30:112
219549942,1cyclictest30996-21expr07:30:102
219489942,1cyclictest18970-21cstates08:20:121
219429942,1cyclictest24268-21head07:15:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional