You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-24 - 10:58
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot3.osadl.org (updated Wed Dec 24, 2025 00:45:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21852205170,23sleep30-21swapper/319:06:363
24142204170,23sleep20-21swapper/219:09:272
22452203170,22sleep10-21swapper/119:07:221
21872200167,22sleep00-21swapper/019:06:360
1606421730,6sleep1279699cyclictest21:50:211
934321630,2sleep0279599cyclictest19:20:240
2795997312,19cyclictest16006-21cut00:05:210
279799630,21cyclictest27625-21/usr/sbin/munin00:30:142
279799621,21cyclictest10341-21date21:40:012
279799620,28cyclictest21258-21taskset20:55:012
279599624,27cyclictest32654-21seq21:16:580
279599624,27cyclictest32654-21seq21:16:570
279799610,23cyclictest27976-21sshd21:07:412
279799610,19cyclictest17419-21latency_hist21:55:012
2797995714,17cyclictest28130-21latency_hist23:25:002
279799570,23cyclictest8613-21chrt22:41:152
279599571,23cyclictest18621-21seq20:49:260
279799561,33cyclictest18675-21latency_hist20:50:002
279599550,2cyclictest12401-21seq21:43:460
139391550,1ptp4l401ktimersoftd/322:04:163
279799540,20cyclictest11851-21sensors19:25:272
222682540,3sleep30-21swapper/323:10:253
139391540,1ptp4l401ktimersoftd/322:15:303
139391530,1ptp4l401ktimersoftd/320:05:033
323762520,1sleep10-21swapper/121:15:251
323762520,1sleep10-21swapper/121:15:251
279799520,22cyclictest2814-21/usr/sbin/munin19:10:152
279599511,3cyclictest22939-21runrttasks23:12:350
279599510,3cyclictest32666-21runrttasks23:32:480
279599510,3cyclictest2762-21runrttasks23:38:340
115042510,2sleep30-21swapper/323:55:223
2795994911,27cyclictest19656-21seq19:44:470
279599490,3cyclictest4591-21runrttasks19:10:330
279799480,27cyclictest27036-21/usr/sbin/munin20:00:242
279599480,3cyclictest27913-21seq23:22:330
279799471,18cyclictest1300-21snmpd23:50:122
279799470,27cyclictest22309-21chrt00:19:442
279799470,25cyclictest28347-21/usr/sbin/munin23:25:122
279599470,3cyclictest25540-21runrttasks21:01:560
2797994630,13cyclictest33-21ksoftirqd/223:45:002
279699462,41cyclictest8913-21cron22:45:001
279599460,2cyclictest28864-21runrttasks20:01:150
2795994412,21cyclictest1317-21runrttasks00:21:490
2795994338,3cyclictest22044-21cron19:50:010
139391430,0ptp4l401ktimersoftd/323:21:173
139391430,0ptp4l401ktimersoftd/320:25:513
139391430,0ptp4l401ktimersoftd/319:26:063
57898420,7rtkit-daemon0-21swapper/119:53:201
2798994237,3cyclictest41-21ksoftirqd/321:04:593
2798994237,2cyclictest41-21ksoftirqd/320:40:003
279599429,22cyclictest1317-21runrttasks20:17:250
139391420,0ptp4l401ktimersoftd/323:27:153
139391420,0ptp4l401ktimersoftd/320:41:173
2798994135,3cyclictest41-21ksoftirqd/322:25:003
279599417,21cyclictest6338-21seq20:21:490
279599412,3cyclictest14564-21seq21:46:130
279599411,2cyclictest0-21swapper/022:50:040
279599411,2cyclictest0-21swapper/022:38:530
279599411,2cyclictest0-21swapper/000:19:460
279599410,2cyclictest121rcu_preempt22:25:260
2798994035,3cyclictest41-21ksoftirqd/321:40:003
2798994035,3cyclictest41-21ksoftirqd/300:20:003
279899400,3cyclictest121rcu_preempt00:25:283
279599401,3cyclictest1317-21runrttasks22:56:090
279599401,3cyclictest12594-21seq23:59:280
279599400,4cyclictest31562-21seq00:36:460
279599400,3cyclictest1317-21runrttasks22:43:020
139391400,0ptp4l401ktimersoftd/319:35:363
139391400,0ptp4l401ktimersoftd/300:33:223
2798993934,3cyclictest41-21ksoftirqd/320:55:003
2798993928,9cyclictest41-21ksoftirqd/321:40:243
279899390,2cyclictest121rcu_preempt23:50:243
279799396,17cyclictest0-21swapper/219:22:072
279799390,18cyclictest1300-21snmpd00:11:362
279799390,18cyclictest1300-21snmpd00:11:362
279799390,17cyclictest1300-21snmpd20:54:372
279599391,3cyclictest1317-21runrttasks22:17:260
279599391,2cyclictest0-21swapper/019:28:470
279599391,2cyclictest0-21swapper/000:10:030
279599391,2cyclictest0-21swapper/000:10:030
279599390,3cyclictest27010-21seq00:29:040
279599390,3cyclictest17124-21runrttasks21:53:350
279599390,3cyclictest1317-21runrttasks21:29:330
2798993835,2cyclictest41-21ksoftirqd/300:40:013
2798993832,3cyclictest41-21ksoftirqd/319:14:593
279799381,22cyclictest11193-21chrt20:30:342
279799380,27cyclictest17285-21chrt19:40:002
279599380,4cyclictest11240-21seq20:31:120
279599380,3cyclictest1317-21runrttasks23:41:390
2798993733,2cyclictest41-21ksoftirqd/322:45:003
2798993733,2cyclictest41-21ksoftirqd/322:29:593
2798993732,3cyclictest41-21ksoftirqd/321:25:013
2798993732,3cyclictest41-21ksoftirqd/320:19:593
2797993731,4cyclictest33-21ksoftirqd/222:08:352
279799370,23cyclictest13420-21/usr/sbin/munin00:00:172
279799370,22cyclictest20745-21chrt23:09:442
279799370,22cyclictest19427-21chrt19:41:572
279599371,2cyclictest0-21swapper/021:57:040
279599371,2cyclictest0-21swapper/021:35:030
279599371,2cyclictest0-21swapper/000:03:410
279599370,4cyclictest20589-21seq23:07:500
279599370,3cyclictest11252-21seq22:49:400
279599370,2cyclictest1317-21runrttasks22:12:370
279899364,3cyclictest41-21ksoftirqd/320:35:013
2798993632,2cyclictest41-21ksoftirqd/322:34:593
2798993631,3cyclictest41-21ksoftirqd/320:55:253
2798993631,3cyclictest41-21ksoftirqd/319:45:003
2798993631,2cyclictest41-21ksoftirqd/321:35:003
2798993625,9cyclictest41-21ksoftirqd/321:55:273
279899361,7cyclictest20339-21unixbench_multi23:05:283
279799365,18cyclictest14649-21sshd21:47:172
2797993631,3cyclictest33-21ksoftirqd/220:10:002
2797993630,4cyclictest33-21ksoftirqd/222:15:362
279799361,21cyclictest2837-21taskset23:39:282
279799360,26cyclictest13779-21sshd20:38:172
279599360,3cyclictest7484-21seq23:47:280
279599360,3cyclictest25593-21runrttasks23:18:210
279599360,3cyclictest23131-21runrttasks20:56:390
2798993531,3cyclictest41-21ksoftirqd/319:20:173
2798993531,2cyclictest41-21ksoftirqd/321:50:013
2798993530,3cyclictest41-21ksoftirqd/319:19:593
2798993530,3cyclictest41-21ksoftirqd/300:20:163
2798993530,2cyclictest41-21ksoftirqd/323:40:193
2798993529,4cyclictest41-21ksoftirqd/323:33:433
279799358,16cyclictest1317-21runrttasks20:44:272
2797993529,4cyclictest33-21ksoftirqd/221:42:502
279799351,21cyclictest11516-21cat23:55:222
279799350,21cyclictest6484-21taskset20:23:362
2796993529,4cyclictest25-21ksoftirqd/123:15:481
2796993529,4cyclictest25-21ksoftirqd/122:21:451
2796993529,4cyclictest25-21ksoftirqd/120:47:391
2796993529,4cyclictest25-21ksoftirqd/119:18:281
2795993528,4cyclictest9-21ksoftirqd/023:01:190
279599351,2cyclictest0-21swapper/023:27:470
279599350,3cyclictest16287-21runrttasks20:44:530
139391350,0ptp4l401ktimersoftd/320:00:093
279899343,3cyclictest41-21ksoftirqd/321:50:173
2798993431,2cyclictest41-21ksoftirqd/300:10:143
2798993431,2cyclictest41-21ksoftirqd/300:10:143
2798993430,3cyclictest41-21ksoftirqd/300:05:003
2798993430,2cyclictest41-21ksoftirqd/323:00:173
2798993429,3cyclictest41-21ksoftirqd/323:36:163
2798993429,3cyclictest41-21ksoftirqd/322:35:203
2798993428,4cyclictest41-21ksoftirqd/322:50:433
2798993428,4cyclictest41-21ksoftirqd/319:46:303
2798993427,4cyclictest41-21ksoftirqd/322:45:143
2798993423,9cyclictest41-21ksoftirqd/300:05:293
279899340,3cyclictest121rcu_preempt23:45:183
2797993428,4cyclictest33-21ksoftirqd/222:46:372
2797993427,5cyclictest33-21ksoftirqd/220:15:142
279799341,17cyclictest1300-21snmpd19:18:422
279799340,20cyclictest31541-21chrt22:22:582
279799340,20cyclictest145872sleep219:30:482
279799340,20cyclictest145872sleep219:30:482
279799340,20cyclictest13423-21chrt22:52:142
2796993429,3cyclictest25-21ksoftirqd/123:25:001
2796993429,3cyclictest23142-21cron23:15:001
2796993428,4cyclictest25-21ksoftirqd/121:08:561
2796993428,4cyclictest25-21ksoftirqd/120:59:421
2796993428,4cyclictest25-21ksoftirqd/120:39:511
2796993428,4cyclictest25-21ksoftirqd/120:10:511
2796993428,4cyclictest25-21ksoftirqd/100:12:531
2796993428,4cyclictest25-21ksoftirqd/100:12:531
2795993428,4cyclictest9-21ksoftirqd/019:16:110
279599342,19cyclictest0-21swapper/022:20:230
139391340,0ptp4l401ktimersoftd/321:15:193
139391340,0ptp4l401ktimersoftd/321:15:183
2798993329,3cyclictest41-21ksoftirqd/321:05:193
2798993328,3cyclictest41-21ksoftirqd/321:25:183
2798993328,3cyclictest41-21ksoftirqd/321:15:003
2798993328,3cyclictest41-21ksoftirqd/320:20:213
2798993328,3cyclictest41-21ksoftirqd/319:50:213
2797993328,3cyclictest33-21ksoftirqd/223:50:012
2797993328,3cyclictest33-21ksoftirqd/221:25:112
2797993327,4cyclictest33-21ksoftirqd/222:11:552
279799331,17cyclictest0-21swapper/221:20:272
279799331,17cyclictest0-21swapper/200:09:332
279799330,20cyclictest24407-21chrt19:54:592
2796993327,4cyclictest25-21ksoftirqd/123:01:201
2796993327,4cyclictest25-21ksoftirqd/122:06:521
2796993327,4cyclictest25-21ksoftirqd/121:22:121
2796993327,4cyclictest25-21ksoftirqd/121:01:431
2796993327,4cyclictest25-21ksoftirqd/120:15:441
2796993327,4cyclictest25-21ksoftirqd/120:08:581
2795993327,4cyclictest9-21ksoftirqd/022:01:060
2795993327,4cyclictest9-21ksoftirqd/020:07:370
279899323,3cyclictest41-21ksoftirqd/322:10:183
2798993228,3cyclictest41-21ksoftirqd/319:30:193
2798993228,3cyclictest41-21ksoftirqd/319:30:193
2798993227,3cyclictest41-21ksoftirqd/320:14:513
2798993227,3cyclictest41-21ksoftirqd/320:00:013
2797993227,3cyclictest33-21ksoftirqd/221:56:442
2797993226,4cyclictest33-21ksoftirqd/219:48:512
2797993225,5cyclictest33-21ksoftirqd/220:25:522
2797993217,12cyclictest33-21ksoftirqd/223:10:142
279799320,18cyclictest0-21swapper/221:14:032
2796993228,3cyclictest25-21ksoftirqd/122:50:131
2796993227,3cyclictest25-21ksoftirqd/123:40:191
2796993227,3cyclictest25-21ksoftirqd/122:00:111
2796993227,3cyclictest25-21ksoftirqd/119:43:511
2796993227,3cyclictest25-21ksoftirqd/119:33:211
2796993227,3cyclictest25-21ksoftirqd/119:33:211
2796993227,3cyclictest25-21ksoftirqd/119:14:301
2796993226,4cyclictest25-21ksoftirqd/123:48:541
2796993226,4cyclictest25-21ksoftirqd/123:07:501
2796993226,4cyclictest25-21ksoftirqd/122:45:031
2796993226,4cyclictest25-21ksoftirqd/122:30:431
2796993226,4cyclictest25-21ksoftirqd/119:49:291
2796993226,4cyclictest25-21ksoftirqd/119:36:211
2796993226,4cyclictest25-21ksoftirqd/119:21:571
2796993226,4cyclictest25-21ksoftirqd/100:26:411
2795993226,4cyclictest9-21ksoftirqd/021:32:450
2795993226,4cyclictest9-21ksoftirqd/020:11:510
2795993226,4cyclictest9-21ksoftirqd/019:56:300
279599320,4cyclictest3766-21runrttasks22:30:460
2798993125,4cyclictest41-21ksoftirqd/323:15:543
279799313,27cyclictest24077-21kworker/2:222:00:462
2797993126,3cyclictest33-21ksoftirqd/219:55:112
2797993126,3cyclictest33-21ksoftirqd/200:37:342
2797993125,4cyclictest33-21ksoftirqd/223:16:292
279799311,28cyclictest24077-21kworker/2:222:35:212
2797993112,16cyclictest22717-21ls00:20:142
2796993127,3cyclictest25-21ksoftirqd/122:27:461
2796993125,4cyclictest25-21ksoftirqd/123:50:541
2796993125,4cyclictest25-21ksoftirqd/123:38:351
2796993125,4cyclictest25-21ksoftirqd/121:56:531
279599316,22cyclictest449-21dbus-daemon23:50:240
2795993125,4cyclictest9-21ksoftirqd/019:36:040
279599311,2cyclictest29100-21runrttasks00:30:330
279599310,4cyclictest9110-21apt-key20:30:000
279599310,4cyclictest24417-21latency_hist19:55:000
2171723125,3sleep125-21ksoftirqd/100:15:261
2798993025,3cyclictest41-21ksoftirqd/322:10:003
279899301,2cyclictest121rcu_preempt22:55:193
2797993025,3cyclictest33-21ksoftirqd/222:56:582
2797993025,3cyclictest33-21ksoftirqd/222:31:582
279799301,16cyclictest30716-21/usr/sbin/munin23:30:222
279799300,18cyclictest0-21swapper/200:28:022
2796993025,3cyclictest25-21ksoftirqd/120:00:131
2796993024,4cyclictest25-21ksoftirqd/122:13:061
2796993024,4cyclictest25-21ksoftirqd/120:27:171
2795993025,3cyclictest9-21ksoftirqd/020:52:440
2795993024,3cyclictest9-21ksoftirqd/022:05:140
139391300,0ptp4l401ktimersoftd/320:45:183
279799299,17cyclictest31439-21irqrtprio21:15:182
279799299,17cyclictest31439-21irqrtprio21:15:182
2797992924,3cyclictest33-21ksoftirqd/223:04:352
2797992913,14cyclictest24156-21fschecks_time21:00:202
279799290,28cyclictest31245-21kworker/2:120:13:382
2796992924,3cyclictest25-21ksoftirqd/122:35:131
2796992924,3cyclictest25-21ksoftirqd/121:47:481
2796992924,3cyclictest25-21ksoftirqd/119:26:301
2796992924,3cyclictest25-21ksoftirqd/100:00:111
2796992923,4cyclictest25-21ksoftirqd/121:37:321
2796992923,4cyclictest25-21ksoftirqd/119:56:121
2796992923,4cyclictest25-21ksoftirqd/100:37:361
279599290,3cyclictest27070-21meminfo21:05:200
279799289,16cyclictest5853-21expr21:30:152
2796992823,3cyclictest25-21ksoftirqd/123:32:101
2796992823,3cyclictest25-21ksoftirqd/121:29:421
2796992823,3cyclictest25-21ksoftirqd/120:51:311
2796992823,3cyclictest25-21ksoftirqd/100:24:221
2796992822,4cyclictest25-21ksoftirqd/120:30:341
279599288,17cyclictest13721-21cut19:30:180
279599288,17cyclictest13721-21cut19:30:180
279599287,18cyclictest29256-21cut21:10:210
279599286,19cyclictest11957-21cpuspeed_turbos20:35:140
2795992822,3cyclictest9-21ksoftirqd/021:20:060
2796992721,4cyclictest25-21ksoftirqd/123:56:161
2796992721,4cyclictest25-21ksoftirqd/122:15:191
279799261,23cyclictest27861-1kworker/2:2H22:30:002
2796992621,3cyclictest25-21ksoftirqd/123:28:241
2796992520,3cyclictest25-21ksoftirqd/100:33:071
2796992519,4cyclictest25-21ksoftirqd/121:41:571
2796992418,4cyclictest25-21ksoftirqd/100:08:151
2796992411,12cyclictest0-21swapper/120:20:441
2796992217,3cyclictest25-21ksoftirqd/122:57:521
2796992217,3cyclictest25-21ksoftirqd/121:31:391
2796992217,3cyclictest25-21ksoftirqd/121:12:411
2796991913,4cyclictest25-21ksoftirqd/120:42:551
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional