You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-05 - 12:42
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4.osadl.org (updated Fri Dec 05, 2025 00:44:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4630212763,8sleep20-21swapper/219:06:552
4626212362,6sleep30-21swapper/319:06:523
47282111102,6sleep10-21swapper/119:08:101
3936210996,8sleep00-21swapper/019:05:200
186832990,0sleep118682-21/usr/sbin/munin22:55:261
255532640,0sleep00-21swapper/023:15:210
212782640,0sleep120-21rcuc/122:10:211
196752610,0sleep10-21swapper/100:00:231
284772600,0sleep10-21swapper/123:35:011
153232570,0sleep00-21swapper/023:26:500
33952550,0sleep10-21swapper/122:17:261
179962530,0sleep30-21swapper/321:23:483
505199280,27cyclictest0-21swapper/221:22:312
505199270,25cyclictest30550-21/usr/sbin/munin23:20:242
504799270,26cyclictest0-21swapper/123:20:061
504799270,26cyclictest0-21swapper/122:20:141
504799270,26cyclictest0-21swapper/121:10:481
504799270,26cyclictest0-21swapper/120:32:041
504799270,20cyclictest13656-21munin-run21:05:001
504399270,26cyclictest0-21swapper/023:50:390
504399270,26cyclictest0-21swapper/000:06:060
5051992618,7cyclictest0-21swapper/222:38:232
505199260,25cyclictest0-21swapper/223:30:542
505199260,25cyclictest0-21swapper/222:13:382
505199260,25cyclictest0-21swapper/200:25:332
504799263,20cyclictest0-21swapper/122:05:191
5047992616,8cyclictest26326-21ssh22:29:591
504799260,25cyclictest0-21swapper/121:27:181
504799260,25cyclictest0-21swapper/120:45:061
504799260,25cyclictest0-21swapper/119:15:541
505199250,25cyclictest0-21swapper/220:13:132
505199250,25cyclictest0-21swapper/220:13:132
505199250,17cyclictest14232-40mandb00:00:002
504799252,17cyclictest0-21swapper/100:20:131
504799251,12cyclictest0-21swapper/121:50:351
504399250,23cyclictest4674-21ssh22:18:490
5051992422,2cyclictest0-21swapper/221:36:472
505199242,21cyclictest0-21swapper/223:03:192
505199241,22cyclictest0-21swapper/221:33:312
5051992410,13cyclictest0-21swapper/200:17:422
505199240,23cyclictest0-21swapper/221:55:192
505199240,23cyclictest0-21swapper/200:10:032
504799243,20cyclictest0-21swapper/123:25:421
504799242,2cyclictest3886-21ssh21:46:171
504799242,2cyclictest0-21swapper/121:37:351
5047992422,2cyclictest0-21swapper/121:43:351
504799240,23cyclictest0-21swapper/119:47:131
504799240,23cyclictest0-21swapper/100:39:161
504799240,18cyclictest0-21swapper/123:40:401
504799240,18cyclictest0-21swapper/122:44:161
504399247,16cyclictest0-21swapper/021:18:110
505199231,21cyclictest0-21swapper/222:18:172
505199230,22cyclictest0-21swapper/223:40:532
505199230,22cyclictest0-21swapper/223:25:102
505199230,22cyclictest0-21swapper/222:57:552
505199230,22cyclictest0-21swapper/222:29:322
505199230,22cyclictest0-21swapper/221:44:132
505199230,22cyclictest0-21swapper/220:17:552
505199230,22cyclictest0-21swapper/220:17:542
505199230,22cyclictest0-21swapper/200:38:452
505199230,17cyclictest0-21swapper/221:28:452
504799233,16cyclictest3987-21ssh21:15:411
5047992321,2cyclictest0-21swapper/123:45:361
5047992321,2cyclictest0-21swapper/122:49:321
5047992321,2cyclictest0-21swapper/120:41:371
5047992321,2cyclictest0-21swapper/119:58:041
504799230,22cyclictest0-21swapper/122:34:531
504799230,22cyclictest0-21swapper/100:11:341
504399237,15cyclictest0-21swapper/023:38:260
504399230,22cyclictest0-21swapper/021:43:040
504399230,22cyclictest0-21swapper/021:33:490
504399230,17cyclictest0-21swapper/023:41:120
505199226,15cyclictest0-21swapper/221:45:152
505199222,19cyclictest0-21swapper/223:36:332
505199222,15cyclictest0-21swapper/221:12:062
5051992220,2cyclictest0-21swapper/219:32:402
505199220,3cyclictest0-21swapper/200:02:032
505199220,21cyclictest0-21swapper/223:15:282
505199220,21cyclictest0-21swapper/223:05:022
505199220,21cyclictest0-21swapper/222:53:292
505199220,21cyclictest0-21swapper/222:45:042
505199220,21cyclictest0-21swapper/222:42:122
505199220,21cyclictest0-21swapper/222:32:202
505199220,21cyclictest0-21swapper/221:50:522
505199220,21cyclictest0-21swapper/219:24:132
504799227,14cyclictest0-21swapper/100:30:191
504799222,14cyclictest0-21swapper/123:37:061
5047992220,2cyclictest0-21swapper/100:29:541
5047992214,7cyclictest0-21swapper/123:07:361
504799221,13cyclictest0-21swapper/122:00:381
504799220,21cyclictest0-21swapper/123:11:201
504799220,21cyclictest0-21swapper/121:55:061
504799220,21cyclictest0-21swapper/120:14:431
504799220,21cyclictest0-21swapper/120:14:421
504799220,16cyclictest0-21swapper/123:16:221
504799220,16cyclictest0-21swapper/120:50:081
504399222,15cyclictest0-21swapper/000:15:440
5043992218,2cyclictest24784-21sadc22:44:590
5043992215,6cyclictest0-21swapper/023:48:030
504399220,21cyclictest0-21swapper/023:09:280
504399220,21cyclictest0-21swapper/022:50:230
504399220,21cyclictest0-21swapper/022:25:190
504399220,21cyclictest0-21swapper/021:54:280
504399220,21cyclictest0-21swapper/021:49:040
504399220,21cyclictest0-21swapper/021:38:220
504399220,21cyclictest0-21swapper/000:39:100
504399220,21cyclictest0-21swapper/000:26:360
504399220,21cyclictest0-21swapper/000:10:530
504399220,17cyclictest0-21swapper/021:28:040
504399220,16cyclictest0-21swapper/023:24:300
504399220,16cyclictest0-21swapper/021:13:220
5051992117,3cyclictest0-21swapper/220:57:252
505199211,19cyclictest0-21swapper/220:33:072
505199210,3cyclictest0-21swapper/200:09:272
505199210,20cyclictest0-21swapper/223:46:062
505199210,20cyclictest0-21swapper/222:24:562
505199210,20cyclictest0-21swapper/222:05:162
505199210,20cyclictest0-21swapper/221:15:022
505199210,20cyclictest0-21swapper/200:32:332
505199210,19cyclictest0-21swapper/223:51:542
505199210,15cyclictest0-21swapper/223:12:002
505199210,15cyclictest0-21swapper/222:00:222
505199210,15cyclictest0-21swapper/200:24:282
504799214,2cyclictest12454-21systemd-journal19:10:261
504799212,14cyclictest0-21swapper/121:21:181
504799212,13cyclictest27590-21smartctl23:50:161
5047992119,2cyclictest0-21swapper/120:22:541
504799210,20cyclictest0-21swapper/123:58:571
504799210,20cyclictest0-21swapper/123:04:051
504799210,20cyclictest0-21swapper/121:30:271
504799210,20cyclictest0-21swapper/120:06:511
504799210,20cyclictest0-21swapper/119:39:371
504799210,20cyclictest0-21swapper/100:05:301
504799210,15cyclictest0-21swapper/122:39:331
504399217,13cyclictest0-21swapper/021:21:410
5043992117,3cyclictest10272-21snmpd19:49:010
504399210,20cyclictest0-21swapper/023:10:390
504399210,20cyclictest0-21swapper/022:21:050
504399210,20cyclictest0-21swapper/019:58:580
504399210,20cyclictest0-21swapper/019:21:370
504399210,19cyclictest0-21swapper/023:04:040
5051992018,1cyclictest10272-21snmpd21:01:272
5051992018,1cyclictest10272-21snmpd20:07:572
5051992018,1cyclictest10272-21snmpd20:00:432
5051992018,1cyclictest10272-21snmpd19:51:492
5051992018,1cyclictest10272-21snmpd19:46:522
5051992018,1cyclictest10272-21snmpd19:43:182
5047992018,2cyclictest0-21swapper/119:32:281
5047992016,3cyclictest0-21swapper/120:28:131
504799200,2cyclictest0-21swapper/120:04:371
504799200,2cyclictest0-21swapper/119:53:211
504799200,19cyclictest0-21swapper/119:25:151
504799200,19cyclictest0-21swapper/100:17:421
5043992018,1cyclictest10272-21snmpd20:47:180
5043992018,1cyclictest10272-21snmpd19:43:160
5043992018,1cyclictest10272-21snmpd19:32:010
5043992018,1cyclictest10272-21snmpd19:17:180
5043992018,1cyclictest10272-21snmpd19:10:520
5043992017,2cyclictest10272-21snmpd23:55:210
5043992016,3cyclictest0-21swapper/000:31:130
5043992011,8cyclictest0-21swapper/022:06:560
504399200,19cyclictest0-21swapper/023:30:060
504399200,19cyclictest0-21swapper/022:32:310
505199195,13cyclictest0-21swapper/220:20:132
5051991918,0cyclictest10272-21snmpd20:47:402
5051991917,1cyclictest10272-21snmpd19:36:282
5051991917,1cyclictest10272-21snmpd19:16:132
5051991915,3cyclictest0-21swapper/219:27:542
5047991917,2cyclictest0-21swapper/119:21:461
5047991916,2cyclictest0-21swapper/119:42:511
5047991915,3cyclictest0-21swapper/120:17:131
5047991915,3cyclictest0-21swapper/120:17:131
504799190,2cyclictest0-21swapper/122:50:191
5043991917,1cyclictest17543-21cat20:40:180
5043991917,1cyclictest10272-21snmpd20:30:030
5043991917,1cyclictest10272-21snmpd20:20:030
5043991917,1cyclictest10272-21snmpd20:04:040
5043991917,1cyclictest10272-21snmpd19:52:450
5043991917,1cyclictest10272-21snmpd19:26:000
5043991911,7cyclictest0-21swapper/000:01:210
504399190,5cyclictest0-21swapper/021:56:500
505199182,15cyclictest0-21swapper/220:37:152
5051991817,0cyclictest10272-21snmpd20:50:432
5051991816,1cyclictest10272-21snmpd21:08:282
5051991816,1cyclictest10272-21snmpd20:40:462
5051991816,1cyclictest10272-21snmpd19:11:402
5051991815,2cyclictest0-21swapper/220:27:102
5047991816,2cyclictest0-21swapper/121:07:041
5047991816,2cyclictest0-21swapper/120:57:071
504799181,3cyclictest0-21swapper/120:35:121
5043991816,1cyclictest10272-21snmpd19:35:060
5043991816,1cyclictest10272-21snmpd00:23:270
504399180,17cyclictest0-21swapper/022:04:300
504399180,12cyclictest0-21swapper/022:45:080
504399180,12cyclictest0-21swapper/022:35:280
505199172,14cyclictest0-21swapper/219:55:162
5043991716,1cyclictest0-21swapper/020:15:160
5043991716,1cyclictest0-21swapper/020:15:160
5043991715,1cyclictest10272-21snmpd21:07:340
5043991715,1cyclictest10272-21snmpd21:01:310
5043991715,1cyclictest10272-21snmpd20:55:390
5043991715,1cyclictest10272-21snmpd20:11:100
5043991715,1cyclictest10272-21snmpd20:11:090
5043991715,1cyclictest10272-21snmpd20:09:190
504399170,16cyclictest0-21swapper/022:56:530
504399170,11cyclictest0-21swapper/022:10:020
243482170,0sleep30-21swapper/320:15:233
243482170,0sleep30-21swapper/320:15:223
76712160,0sleep30-21swapper/323:24:533
5043991614,1cyclictest10272-21snmpd20:25:280
504399160,14cyclictest0-21swapper/020:35:230
44392166,3sleep30-21swapper/320:28:533
317982148,3sleep30-21swapper/322:46:173
5043991311,1cyclictest10272-21snmpd20:53:040
39922130,0sleep338-21rcuc/300:26:543
308142139,3sleep30-21swapper/320:21:573
277072139,3sleep30-21swapper/319:52:583
246412131,3sleep30-21swapper/319:20:253
236942137,3sleep30-21swapper/300:39:253
220252139,3sleep30-21swapper/320:42:043
72882129,2sleep30-21swapper/320:58:103
48502126,3sleep30-21swapper/322:02:473
36832127,3sleep30-21swapper/322:17:493
252442120,2sleep30-21swapper/321:40:553
252352120,3sleep30-21swapper/323:31:353
176482120,3sleep30-21swapper/300:16:013
161962128,3sleep30-21swapper/320:37:583
155652120,4sleep30-21swapper/322:07:473
133872128,3sleep30-21swapper/321:01:463
110442125,4sleep30-21swapper/323:56:353
99822115,3sleep30-21swapper/323:09:403
71542117,3sleep30-21swapper/320:04:273
51482110,3sleep30-21swapper/321:32:093
39442110,6sleep33963-21ssh21:15:393
192382117,3sleep30-21swapper/321:06:153
166312117,3sleep30-21swapper/323:28:143
130692110,3sleep30-21swapper/322:55:063
107912117,3sleep30-21swapper/319:14:323
102712115,3sleep30-21swapper/300:13:533
62552100,2sleep30-21swapper/321:48:373
39812106,3sleep30-21swapper/319:30:583
39202104,3sleep30-21swapper/323:37:403
307972105,3sleep30-21swapper/300:06:243
282232100,2sleep30-21swapper/323:17:453
278482104,3sleep30-21swapper/321:12:363
278202106,3sleep30-21swapper/320:46:083
232642103,4sleep30-21swapper/300:04:003
218972106,3sleep30-21swapper/319:48:493
189782106,3sleep30-21swapper/319:18:463
184362101,6sleep30-21swapper/322:10:163
149162104,3sleep30-21swapper/300:34:403
14852106,3sleep30-21swapper/320:54:163
121852104,3sleep30-21swapper/322:37:353
8437291,5sleep30-21swapper/321:35:113
7436296,2sleep30-21swapper/320:05:113
30934294,3sleep30-21swapper/323:02:583
30665293,3sleep30-21swapper/319:27:273
2895294,3sleep30-21swapper/322:33:553
27896294,3sleep30-21swapper/321:59:013
24666294,3sleep30-21swapper/322:44:523
23223294,3sleep30-21swapper/322:26:383
21259293,3sleep30-21swapper/300:20:023
16241293,3sleep30-21swapper/323:45:013
14801294,3sleep30-21swapper/321:51:333
12627292,4sleep30-21swapper/322:54:503
12256293,3sleep30-21swapper/323:40:403
1034292,3sleep30-21swapper/319:56:253
1027294,3sleep30-21swapper/323:51:463
10215294,3sleep30-21swapper/319:39:563
27257280,5sleep30-21swapper/321:27:303
13344280,5sleep30-21swapper/322:22:083
10471284,3sleep30-21swapper/319:40:033
4761273,3sleep30-21swapper/320:30:103
15774271,3sleep30-21swapper/323:10:283
18853262,3sleep30-21swapper/320:13:483
18853262,3sleep30-21swapper/320:13:483
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional