You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-10-07 - 01:51
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack2slot0.osadl.org (updated Mon Oct 07, 2024 00:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
194482630,0sleep019426-21bash00:14:500
77442600,0sleep00-21swapper/023:17:460
52662560,0sleep30-21swapper/321:12:573
28812560,0sleep10-21swapper/122:07:101
55132550,1sleep05502-21sshd21:25:030
281532550,0sleep20-21swapper/200:15:402
81202540,0sleep30-21swapper/322:53:223
86772530,0sleep30-21swapper/323:14:493
307692530,0sleep10-21swapper/122:18:551
106082530,0sleep10-21swapper/122:38:181
238162520,1sleep023812-21lspci23:07:050
122142520,0sleep00-21swapper/021:31:390
116772520,0sleep00-21swapper/021:49:550
114992520,0sleep20-21swapper/222:38:232
108342520,0sleep10-21swapper/123:51:481
199832510,0sleep20-21swapper/223:18:562
92962500,0sleep125-21ksoftirqd/122:01:411
314692500,1sleep031467-21lspci23:20:020
189642500,0sleep10-21swapper/100:01:441
94722490,1sleep10-21swapper/121:16:191
168302490,0sleep00-21swapper/021:10:580
139392490,1sleep30-21swapper/322:05:113
32512480,0sleep10-21swapper/122:13:191
164882480,2sleep01921499cyclictest00:25:150
159812480,0sleep1231rcuc/122:54:081
206602450,0sleep20-21swapper/222:11:512
18032400,0sleep21747-21sshd23:47:562
1888723833,3sleep30-21swapper/319:07:093
188542309,6sleep00-21swapper/019:06:420
253912210,1sleep125323-21sshd00:19:071
188852219,7sleep10-21swapper/119:07:071
173182219,7sleep20-21swapper/219:05:042
19219991817,0cyclictest22670-21kworker/1:100:33:461
19219991816,1cyclictest9604-21kworker/1:022:28:581
63212170,0sleep20-21swapper/221:31:062
19219991716,0cyclictest6633-21kworker/1:321:59:101
19219991716,0cyclictest300-21kworker/1:021:51:001
19219991716,0cyclictest27204-21kworker/1:023:29:481
19219991716,0cyclictest16763-21kworker/1:023:48:221
135502170,1sleep113553-21kworker/u8:121:28:491
20382160,1sleep20-21swapper/223:41:432
19219991615,0cyclictest6068-21kworker/1:422:43:001
19219991615,0cyclictest30388-21kworker/1:400:06:121
19219991615,0cyclictest18833-21kworker/1:323:58:461
27362150,0sleep22733-21lspci23:05:062
232892150,0sleep10-21swapper/121:11:351
225762150,0sleep20-21swapper/220:35:162
19219991515,0cyclictest33050irq/27-ahci[00021:39:311
19219991515,0cyclictest22855-21kworker/1:100:23:221
19219991514,0cyclictest8674-21kworker/1:421:49:161
19219991514,0cyclictest8220-21kworker/1:400:37:141
19219991514,0cyclictest17299-21snmpd20:57:061
19219991513,1cyclictest27204-21kworker/1:023:22:521
102392150,1sleep010232-21lspci22:32:080
62452140,0sleep1231rcuc/119:55:151
4982140,0sleep10-21swapper/121:24:361
275132140,0sleep00-21swapper/023:25:430
264462140,0sleep30-21swapper/300:02:313
219522140,0sleep021946-21lspci22:42:250
19219991414,0cyclictest3967-21kworker/1:323:18:541
19219991414,0cyclictest30388-21kworker/1:400:12:481
19219991413,0cyclictest33050irq/27-ahci[00023:10:091
1921499140,1cyclictest8314-21sshd23:42:200
1921499140,1cyclictest700-21gdbus23:03:500
18382140,0sleep21825-21sshd00:06:302
168132140,1sleep316811-21gltestperf21:35:123
23762130,0sleep20-21swapper/222:43:402
1923299131,0cyclictest0-21swapper/322:45:593
19232991310,2cyclictest0-21swapper/322:19:493
1922699130,1cyclictest5752-21sshd22:47:002
19219991313,0cyclictest27109-21kworker/1:123:08:401
19219991313,0cyclictest27109-21kworker/1:123:00:201
19219991312,0cyclictest8674-21kworker/1:421:42:101
19219991312,0cyclictest27109-21kworker/1:122:58:161
1921499130,1cyclictest15640-21bash22:14:300
65942120,0sleep30-21swapper/322:56:133
1923299121,0cyclictest7303-21bash23:45:193
1923299120,1cyclictest648-21systemd-logind21:17:493
1923299120,11cyclictest3932-21sshd22:37:393
1923299120,11cyclictest0-21swapper/323:26:393
19226991210,1cyclictest4717-21munin-run21:25:002
1922699120,1cyclictest13701-21sshd23:30:302
1922699120,11cyclictest30467-21sshd23:26:002
1922699120,11cyclictest23317-21sshd21:14:402
19219991212,0cyclictest9604-21kworker/1:022:32:061
19219991212,0cyclictest15781-21kworker/1:220:22:361
19219991211,0cyclictest8220-21kworker/1:400:28:131
19219991211,0cyclictest3324-21kworker/1:019:47:461
19219991211,0cyclictest32636-21kworker/1:223:35:001
19219991210,1cyclictest14037-21sshd22:23:251
1921499120,1cyclictest0-21swapper/023:53:090
1921499120,1cyclictest0-21swapper/023:13:200
19232991110,0cyclictest0-21swapper/321:54:593
1923299110,1cyclictest131rcu_sched23:58:563
1923299110,10cyclictest0-21swapper/321:34:093
1923299110,10cyclictest0-21swapper/321:29:183
1922699119,1cyclictest648-21systemd-logind21:53:002
1922699119,1cyclictest648-21systemd-logind00:38:502
1922699118,2cyclictest648-21systemd-logind21:46:502
1922699110,10cyclictest0-21swapper/222:54:502
1922699110,0cyclictest0-21swapper/223:02:102
1921999112,1cyclictest25-21ksoftirqd/123:39:121
19219991111,0cyclictest31981-21kworker/1:021:08:541
19219991110,0cyclictest27823-21kworker/1:219:43:581
19219991110,0cyclictest21846-21kworker/1:123:43:201
1921499119,1cyclictest10922-21grep22:47:290
1921499119,1cyclictest0-21swapper/023:31:000
19214991110,0cyclictest0-21swapper/020:55:200
1921499110,1cyclictest32408-21sshd00:06:200
1921499110,10cyclictest26881-21sshd00:15:290
1921499110,10cyclictest0-21swapper/022:53:400
1921499110,10cyclictest0-21swapper/022:37:300
1923299109,0cyclictest11878-21lspci22:11:013
1923299109,0cyclictest0-21swapper/323:15:393
1923299109,0cyclictest0-21swapper/320:04:293
1923299109,0cyclictest0-21swapper/300:10:283
1923299100,0cyclictest0-21swapper/323:33:593
1923299100,0cyclictest0-21swapper/321:59:193
1923299100,0cyclictest0-21swapper/300:06:293
1922699109,0cyclictest10926-21sshd21:37:402
1922699109,0cyclictest0-21swapper/223:24:202
1922699109,0cyclictest0-21swapper/223:15:002
1922699109,0cyclictest0-21swapper/222:23:102
1922699109,0cyclictest0-21swapper/200:11:302
1922699100,0cyclictest0-21swapper/223:59:302
1922699100,0cyclictest0-21swapper/221:28:002
1921999109,0cyclictest31981-21kworker/1:021:00:141
1921999108,1cyclictest7941-21sshd21:31:151
19219991010,0cyclictest27823-21kworker/1:219:35:281
19219991010,0cyclictest23683-21kworker/1:220:39:361
1921999100,9cyclictest0-21swapper/120:27:341
1921999100,9cyclictest0-21swapper/120:14:351
1921999100,3cyclictest2585-21sshd22:46:411
1921499109,0cyclictest0-21swapper/022:58:100
1921499109,0cyclictest0-21swapper/021:59:090
1921499108,1cyclictest17009-21bash21:44:200
1921499103,3cyclictest0-21swapper/019:15:000
1921499100,9cyclictest0-21swapper/023:57:100
192329998,0cyclictest0-21swapper/322:03:493
192329998,0cyclictest0-21swapper/300:15:393
192329997,1cyclictest18576-21sshd23:24:583
192269998,0cyclictest0-21swapper/222:59:202
192269996,2cyclictest649-21avahi-daemon21:58:342
192269995,3cyclictest649-21avahi-daemon22:31:212
192199998,0cyclictest27823-21kworker/1:219:30:161
192199998,0cyclictest21049-21kworker/1:019:26:481
192199998,0cyclictest0-21swapper/120:15:151
192199998,0cyclictest0-21swapper/119:19:351
192199997,1cyclictest20712-21kworker/1:120:32:301
192149998,0cyclictest0-21swapper/022:06:300
192149998,0cyclictest0-21swapper/021:09:090
192149998,0cyclictest0-21swapper/000:01:100
192329987,0cyclictest0-21swapper/319:51:293
192329986,1cyclictest41-21ksoftirqd/322:40:273
192329986,1cyclictest41-21ksoftirqd/322:22:253
192329986,1cyclictest2157-21lspci23:01:573
192329986,1cyclictest19689-21lspci00:25:333
192329986,1cyclictest14564-21sshd23:52:093
192329985,2cyclictest649-21avahi-daemon23:08:363
192329985,2cyclictest649-21avahi-daemon22:30:423
192329985,2cyclictest649-21avahi-daemon19:50:003
192329985,2cyclictest649-21avahi-daemon00:31:143
192329985,2cyclictest649-21avahi-daemon00:20:343
192329980,1cyclictest0-21swapper/323:36:083
192269987,0cyclictest28427-21lspci23:38:052
192269987,0cyclictest0-21swapper/221:05:302
192269986,1cyclictest33-21ksoftirqd/221:19:582
192269986,1cyclictest23043-21lspci00:25:552
192199988,0cyclictest27840-21kworker/1:220:50:191
192199988,0cyclictest25760-21kworker/1:120:43:041
192149986,1cyclictest29522-21lspci22:15:420
192149986,1cyclictest1-21systemd21:36:470
192329976,0cyclictest0-21swapper/321:09:193
192329976,0cyclictest0-21swapper/319:40:193
192329975,1cyclictest649-21avahi-daemon23:40:383
192329975,1cyclictest649-21avahi-daemon21:21:193
192329975,1cyclictest41-21ksoftirqd/322:27:433
192329975,1cyclictest41-21ksoftirqd/321:47:373
192329974,2cyclictest26841-21sshd00:37:343
192329973,3cyclictest684-21polkitd21:42:403
192269976,0cyclictest0-21swapper/223:50:202
192269975,1cyclictest684-21polkitd22:15:192
192269975,1cyclictest649-21avahi-daemon22:27:002
192269975,1cyclictest648-21systemd-logind00:20:192
192269975,1cyclictest1-21systemd22:07:392
192269974,2cyclictest649-21avahi-daemon22:01:242
192269974,2cyclictest646-21dbus-daemon00:32:022
192269973,3cyclictest0-21swapper/200:00:272
192199977,0cyclictest3324-21kworker/1:020:08:241
192199977,0cyclictest3324-21kworker/1:019:54:321
192199977,0cyclictest21049-21kworker/1:019:21:461
192149976,1cyclictest8984-21lspci23:36:130
192149975,1cyclictest9-21ksoftirqd/021:15:520
192149975,1cyclictest9-21ksoftirqd/000:38:380
192149975,1cyclictest700-21gdbus22:27:450
192149975,1cyclictest649-21avahi-daemon21:22:380
192149975,1cyclictest4761-21kworker/u8:223:45:130
192149975,1cyclictest24888-21sshd00:33:330
192149974,2cyclictest684-21polkitd22:00:220
192149974,2cyclictest649-21avahi-daemon22:20:170
192149974,2cyclictest649-21avahi-daemon00:23:320
192149974,2cyclictest15307-21sshd21:50:120
10471270,0sleep20-21swapper/221:40:342
192329965,0cyclictest0-21swapper/320:56:093
192329964,1cyclictest31383-21grep19:35:193
192329963,2cyclictest17299-21snmpd21:04:473
192329963,2cyclictest17299-21snmpd20:53:423
192329963,2cyclictest17299-21snmpd20:28:533
192329963,2cyclictest17299-21snmpd20:07:193
192329963,2cyclictest17299-21snmpd19:26:583
192329963,2cyclictest17299-21snmpd19:22:563
192269964,1cyclictest33-21ksoftirqd/220:20:002
192269962,1cyclictest0-21swapper/220:01:312
192199966,0cyclictest25760-21kworker/1:120:45:081
192199966,0cyclictest18935-21kworker/1:219:10:011
192199965,1cyclictest3324-21kworker/1:020:00:201
192149965,0cyclictest0-21swapper/020:35:300
192149965,0cyclictest0-21swapper/019:55:190
192149964,1cyclictest17299-21snmpd20:27:470
192329954,0cyclictest0-21swapper/320:11:583
192329953,1cyclictest682-21lsmd20:16:503
192329953,1cyclictest649-21avahi-daemon19:56:073
192329953,1cyclictest17299-21snmpd20:40:593
192329953,1cyclictest17299-21snmpd20:36:013
192329953,1cyclictest17299-21snmpd19:30:403
192329953,1cyclictest17299-21snmpd19:19:243
192329953,1cyclictest1017-21runrttasks20:45:333
192329952,2cyclictest17299-21snmpd20:30:533
192329950,0cyclictest0-21swapper/320:22:593
192269954,0cyclictest0-21swapper/220:50:192
192269953,1cyclictest649-21avahi-daemon19:35:002
192269953,1cyclictest26805-21cat20:45:132
192269953,1cyclictest17299-21snmpd20:56:032
192269953,1cyclictest17299-21snmpd20:41:022
192269953,1cyclictest17299-21snmpd20:30:052
192269953,1cyclictest17299-21snmpd20:26:412
192269953,1cyclictest17299-21snmpd20:10:172
192269953,1cyclictest17299-21snmpd20:05:312
192269953,1cyclictest17299-21snmpd19:45:282
192269953,1cyclictest17299-21snmpd19:28:012
192269953,1cyclictest17299-21snmpd19:21:002
192269953,1cyclictest17299-21snmpd19:18:212
192269953,1cyclictest17299-21snmpd19:10:532
192269953,1cyclictest16623-21cat20:20:132
192269952,2cyclictest17299-21snmpd19:42:012
192269952,2cyclictest17299-21snmpd19:32:222
192269950,1cyclictest897-21ntp_states21:00:162
192269950,1cyclictest3903-21/usr/sbin/munin19:50:182
192149954,0cyclictest0-21swapper/020:46:300
192149953,1cyclictest700-21gdbus19:54:590
192149953,1cyclictest648-21systemd-logind19:45:000
192149953,1cyclictest25143-21grep20:40:170
192149953,1cyclictest17299-21snmpd21:00:420
192149953,1cyclictest17299-21snmpd20:50:480
192149953,1cyclictest17299-21snmpd20:32:440
192149953,1cyclictest17299-21snmpd20:23:590
192149953,1cyclictest17299-21snmpd20:13:170
192149953,1cyclictest17299-21snmpd20:06:210
192149953,1cyclictest17299-21snmpd20:00:490
192149953,1cyclictest17299-21snmpd19:47:220
192149953,1cyclictest17299-21snmpd19:35:250
192149953,1cyclictest17299-21snmpd19:20:120
192149953,1cyclictest1109-21ntpd19:15:020
192149952,2cyclictest28488-21tail19:30:130
192329942,1cyclictest0-21swapper/319:10:133
192269942,1cyclictest5939-21/usr/sbin/munin19:55:152
192149942,1cyclictest26562-21cat19:25:140
192149942,1cyclictest17299-21snmpd20:15:050
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional