You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-26 - 07:32
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot3.osadl.org (updated Thu Mar 26, 2026 00:45:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
133372203170,22sleep10-21swapper/119:06:411
134932202169,22sleep20-21swapper/219:08:432
134642202169,22sleep00-21swapper/019:08:200
133392202168,23sleep30-21swapper/319:06:433
1394918261,11phc2sys0-21swapper/319:10:003
139391650,2ptp4l401ktimersoftd/323:00:143
139391650,1ptp4l401ktimersoftd/321:24:313
13888996312,49cyclictest30316-21kworker/2:100:15:332
1388699625,16cyclictest0-21swapper/021:55:010
13886996010,10cyclictest29634-21grep21:55:250
279082590,3sleep01388699cyclictest00:09:130
1388699599,16cyclictest1654-21irqrtprio00:20:190
1388699584,16cyclictest0-21swapper/023:10:210
1388699564,15cyclictest0-21swapper/021:05:000
1388799540,1cyclictest0-21swapper/123:47:531
1388699547,15cyclictest32436-21if_enp1s020:55:170
1388699545,15cyclictest0-21swapper/021:40:180
1388699545,15cyclictest0-21swapper/000:00:220
1388699545,11cyclictest17653-21switchtime23:45:250
1388699544,16cyclictest0-21swapper/022:40:280
220832530,1sleep00-21swapper/020:35:010
1388699538,17cyclictest23507-21systemctl22:50:230
1388699528,15cyclictest8946-21latency_hist23:30:010
1388699526,15cyclictest3250-21/usr/sbin/munin00:25:220
1388699513,16cyclictest0-21swapper/019:20:250
13886995112,9cyclictest6872-21tr22:15:240
13886995112,9cyclictest6872-21tr22:15:240
1388699508,16cyclictest7254-21if_err_enp1s021:10:160
1388699507,7cyclictest9937-21kernelversion23:30:190
1388699497,7cyclictest24838-21switchtime19:30:250
1388699488,8cyclictest26909-21apt-get23:00:110
1388699488,8cyclictest10878-21lsb_release21:16:100
1388699486,7cyclictest22684-21ls19:25:250
1388699478,7cyclictest28098-21open_files20:45:190
1388699475,7cyclictest20928-21apt-get23:55:110
1388699468,7cyclictest19480-21iostat_ios21:35:180
1388699466,7cyclictest28275-21apt-config19:40:010
1388699466,7cyclictest13004-21ls23:35:260
1388699466,14cyclictest28251-21apt-get00:10:130
1388699464,16cyclictest0-21swapper/023:50:160
13887994516,27cyclictest0-21swapper/120:30:041
1388699458,7cyclictest5900-21df_inode20:00:140
1388699455,8cyclictest32086-21ps00:15:240
1388699453,16cyclictest0-21swapper/023:15:010
1388699448,7cyclictest26420-21iostat19:35:180
139391430,0ptp4l401ktimersoftd/320:30:303
1388699437,8cyclictest13922-21apt-get19:10:120
1388699437,7cyclictest25534-21ls22:55:180
1388699437,12cyclictest11705-21cstates21:20:130
1388699436,7cyclictest11806-21ls20:10:240
1388699435,7cyclictest31084-21ls20:50:260
139391420,0ptp4l401ktimersoftd/319:31:513
1388999421,38cyclictest23335-21cron21:45:003
1388799429,3cyclictest18461-21ls22:40:251
1388699426,7cyclictest18100-21ps20:25:190
1388699426,7cyclictest13899-21ps22:30:210
139391410,0ptp4l401ktimersoftd/319:38:233
1388699417,8cyclictest16105-21meminfo20:20:210
1388699405,7cyclictest9635-21ls00:35:250
1388699405,7cyclictest17576-21ps19:15:240
57898390,2rtkit-daemon0-21swapper/300:00:103
1388699396,13cyclictest25158-21if_enp4s020:40:160
1388699395,7cyclictest4934-21ps23:20:180
139391380,0ptp4l401ktimersoftd/322:02:593
13889993832,3cyclictest41-21ksoftirqd/323:26:103
13889993732,3cyclictest41-21ksoftirqd/323:00:003
13888993731,4cyclictest33-21ksoftirqd/221:39:582
13888993730,4cyclictest33-21ksoftirqd/222:45:592
13887993732,3cyclictest25-21ksoftirqd/119:30:011
13887993731,4cyclictest25-21ksoftirqd/121:28:091
57898360,7rtkit-daemon0-21swapper/319:24:173
13888993630,4cyclictest33-21ksoftirqd/221:00:002
13888993630,4cyclictest33-21ksoftirqd/200:36:402
1388899361,33cyclictest21925-21kworker/2:019:15:242
13888993613,20cyclictest5775-21expr20:00:132
13888993613,20cyclictest10200-21sed20:10:002
1388799368,26cyclictest0-21swapper/123:50:031
13887993630,4cyclictest25-21ksoftirqd/119:23:251
13887993629,4cyclictest25-21ksoftirqd/122:17:591
13887993629,4cyclictest25-21ksoftirqd/122:17:591
57898350,1rtkit-daemon0-21swapper/300:23:083
13889993530,3cyclictest41-21ksoftirqd/320:40:253
13889993530,3cyclictest41-21ksoftirqd/320:08:443
13889993530,3cyclictest41-21ksoftirqd/320:03:433
13889993529,4cyclictest41-21ksoftirqd/319:28:013
13889993529,4cyclictest41-21ksoftirqd/300:05:083
13889993528,4cyclictest41-21ksoftirqd/320:15:583
13888993529,4cyclictest33-21ksoftirqd/223:18:022
13888993529,4cyclictest33-21ksoftirqd/221:43:182
13888993529,4cyclictest33-21ksoftirqd/221:10:052
13888993528,4cyclictest33-21ksoftirqd/220:46:432
1388799356,27cyclictest0-21swapper/120:00:341
13887993529,4cyclictest25-21ksoftirqd/119:56:591
1388799350,1cyclictest0-21swapper/119:19:041
1388699358,7cyclictest14924-21memory21:25:210
57898340,5rtkit-daemon1451-21mactelnetd22:45:253
57898340,2rtkit-daemon0-21swapper/223:35:532
139391340,0ptp4l401ktimersoftd/322:40:233
13889993429,3cyclictest41-21ksoftirqd/323:20:073
13889993429,3cyclictest41-21ksoftirqd/320:45:163
13889993429,3cyclictest41-21ksoftirqd/319:59:593
13889993428,4cyclictest41-21ksoftirqd/322:52:033
13889993428,3cyclictest41-21ksoftirqd/321:30:583
13888993429,3cyclictest33-21ksoftirqd/223:23:552
13888993428,4cyclictest33-21ksoftirqd/220:44:582
13888993428,4cyclictest33-21ksoftirqd/219:14:332
13888993428,4cyclictest33-21ksoftirqd/200:08:402
13887993429,3cyclictest25-21ksoftirqd/119:51:361
13887993429,3cyclictest25-21ksoftirqd/100:05:111
13887993428,4cyclictest25-21ksoftirqd/122:58:031
13887993428,4cyclictest25-21ksoftirqd/122:31:181
13887993428,4cyclictest25-21ksoftirqd/122:26:101
13887993428,4cyclictest25-21ksoftirqd/121:38:521
13887993428,4cyclictest25-21ksoftirqd/120:55:071
13887993428,4cyclictest25-21ksoftirqd/120:48:011
13887993428,4cyclictest25-21ksoftirqd/120:22:061
13887993428,4cyclictest25-21ksoftirqd/120:19:331
13887993428,4cyclictest25-21ksoftirqd/120:13:231
13887993428,4cyclictest25-21ksoftirqd/119:43:551
13887993428,4cyclictest25-21ksoftirqd/100:16:451
13887993427,4cyclictest366-21cron22:05:001
13889993329,3cyclictest41-21ksoftirqd/321:08:223
13889993328,3cyclictest41-21ksoftirqd/322:35:113
13889993327,4cyclictest41-21ksoftirqd/323:13:453
13889993327,4cyclictest41-21ksoftirqd/320:58:183
13888993328,3cyclictest33-21ksoftirqd/222:38:182
13888993328,3cyclictest33-21ksoftirqd/200:34:462
13888993328,3cyclictest33-21ksoftirqd/200:34:452
13888993327,4cyclictest33-21ksoftirqd/222:26:112
13888993327,4cyclictest33-21ksoftirqd/220:51:282
13888993327,4cyclictest33-21ksoftirqd/220:25:442
13888993327,4cyclictest33-21ksoftirqd/220:23:352
13888993327,4cyclictest33-21ksoftirqd/219:59:162
13888993327,3cyclictest33-21ksoftirqd/219:20:022
13888993312,18cyclictest9271-21expr23:30:132
13888993311,19cyclictest16256-21sort23:45:132
13888993310,20cyclictest207-21systemd-journal21:34:002
13888993310,20cyclictest16042-21cat23:45:002
13887993328,3cyclictest25-21ksoftirqd/123:14:441
13887993328,3cyclictest25-21ksoftirqd/122:09:531
13887993328,3cyclictest25-21ksoftirqd/121:10:011
13887993327,4cyclictest25-21ksoftirqd/123:17:531
13887993327,4cyclictest25-21ksoftirqd/121:20:391
13887993327,4cyclictest25-21ksoftirqd/121:01:451
13887993327,4cyclictest25-21ksoftirqd/100:23:121
13887993327,4cyclictest25-21ksoftirqd/100:11:081
1388699337,9cyclictest22174-21apt-get20:35:110
1388699332,9cyclictest0-21swapper/022:04:260
139391320,9ptp4l0-21swapper/322:19:003
139391320,9ptp4l0-21swapper/322:19:003
13889993227,3cyclictest41-21ksoftirqd/323:17:023
13889993227,3cyclictest41-21ksoftirqd/320:20:323
13889993227,3cyclictest41-21ksoftirqd/319:53:403
13889993226,4cyclictest41-21ksoftirqd/323:08:203
13889993226,4cyclictest41-21ksoftirqd/322:10:593
13889993226,4cyclictest41-21ksoftirqd/321:18:403
13889993226,4cyclictest41-21ksoftirqd/321:11:103
13889993226,4cyclictest41-21ksoftirqd/320:14:383
13888993227,3cyclictest33-21ksoftirqd/222:01:592
13888993227,3cyclictest33-21ksoftirqd/221:10:002
13888993226,4cyclictest33-21ksoftirqd/223:56:132
13888993226,4cyclictest33-21ksoftirqd/223:50:512
13888993226,4cyclictest33-21ksoftirqd/223:05:062
13888993226,4cyclictest33-21ksoftirqd/222:43:522
13888993226,4cyclictest33-21ksoftirqd/219:25:072
13888993226,4cyclictest33-21ksoftirqd/200:02:182
13888993225,4cyclictest33-21ksoftirqd/221:29:462
13888993225,4cyclictest12437-21uname21:20:192
13888993213,16cyclictest1338-21sh19:50:172
13887993227,3cyclictest25-21ksoftirqd/121:58:411
13887993227,3cyclictest25-21ksoftirqd/100:33:421
13887993227,3cyclictest25-21ksoftirqd/100:33:421
13887993227,3cyclictest25-21ksoftirqd/100:04:501
13887993226,4cyclictest25-21ksoftirqd/123:05:331
13887993226,4cyclictest25-21ksoftirqd/123:04:011
13887993226,4cyclictest25-21ksoftirqd/121:32:261
13887993226,4cyclictest25-21ksoftirqd/121:17:221
13887993226,4cyclictest25-21ksoftirqd/100:40:001
1388799321,29cyclictest0-21swapper/100:25:251
1388699323,17cyclictest0-21swapper/021:30:240
13886993226,4cyclictest9-21ksoftirqd/022:09:200
212592310,5sleep31388999cyclictest23:55:133
139391310,1ptp4l401ktimersoftd/322:25:203
139391310,10ptp4l0-21swapper/322:32:063
139391310,0ptp4l401ktimersoftd/323:46:023
139391310,0ptp4l401ktimersoftd/320:25:303
13889993126,3cyclictest41-21ksoftirqd/321:48:543
13889993125,4cyclictest41-21ksoftirqd/321:29:563
13889993125,4cyclictest41-21ksoftirqd/320:38:013
1388899317,23cyclictest21925-21kworker/2:019:32:572
1388899317,22cyclictest9674-21kworker/2:220:15:182
13888993126,3cyclictest33-21ksoftirqd/222:50:322
13888993126,3cyclictest33-21ksoftirqd/222:14:342
13888993126,3cyclictest33-21ksoftirqd/221:58:142
1388899310,29cyclictest0-21swapper/222:55:162
13887993126,3cyclictest25-21ksoftirqd/123:55:121
13887993126,3cyclictest25-21ksoftirqd/122:37:521
13887993126,3cyclictest25-21ksoftirqd/121:50:031
13887993126,3cyclictest25-21ksoftirqd/120:42:391
13887993126,3cyclictest25-21ksoftirqd/120:25:301
13887993126,3cyclictest25-21ksoftirqd/119:31:031
13887993125,4cyclictest25-21ksoftirqd/122:45:071
13887993125,4cyclictest25-21ksoftirqd/120:54:111
1388699313,17cyclictest0-21swapper/022:10:130
13886993125,4cyclictest9-21ksoftirqd/022:48:550
139391300,0ptp4l401ktimersoftd/300:32:033
139391300,0ptp4l401ktimersoftd/300:32:033
139391300,0ptp4l401ktimersoftd/300:16:463
13889993025,3cyclictest41-21ksoftirqd/322:09:553
13889993025,3cyclictest41-21ksoftirqd/321:55:443
13889993025,3cyclictest41-21ksoftirqd/319:47:313
13889993025,3cyclictest41-21ksoftirqd/300:37:503
13889993024,4cyclictest41-21ksoftirqd/323:33:153
13888993025,3cyclictest33-21ksoftirqd/221:15:082
13888993024,4cyclictest33-21ksoftirqd/222:07:592
13888993024,4cyclictest33-21ksoftirqd/220:14:332
13888993024,4cyclictest33-21ksoftirqd/200:14:502
13888993023,4cyclictest33-21ksoftirqd/223:11:402
13888993017,11cyclictest33-21ksoftirqd/221:54:222
13888993011,16cyclictest27120-21ls23:00:132
13887993025,3cyclictest25-21ksoftirqd/123:44:271
13887993025,3cyclictest25-21ksoftirqd/120:06:321
13887993024,4cyclictest25-21ksoftirqd/122:51:571
13887993024,4cyclictest25-21ksoftirqd/121:11:561
13887993024,4cyclictest25-21ksoftirqd/119:10:331
13886993024,4cyclictest9-21ksoftirqd/019:51:170
1388699302,17cyclictest0-21swapper/019:45:110
139391290,0ptp4l401ktimersoftd/323:41:533
139391290,0ptp4l401ktimersoftd/321:52:593
13889992924,3cyclictest41-21ksoftirqd/319:43:583
13889992923,4cyclictest41-21ksoftirqd/300:28:473
13889992923,4cyclictest41-21ksoftirqd/300:14:063
1388899299,3cyclictest2316-21tune2fs21:00:152
1388899299,17cyclictest22014-21latency_hist20:35:012
13888992924,3cyclictest33-21ksoftirqd/200:28:552
13888992923,4cyclictest33-21ksoftirqd/219:46:062
13888992914,13cyclictest9208-21sendmail_mailst22:20:212
13887992924,3cyclictest25-21ksoftirqd/123:35:091
1388799290,27cyclictest0-21swapper/123:32:491
1388699293,16cyclictest0-21swapper/023:05:160
1388699293,16cyclictest0-21swapper/020:15:190
13886992923,4cyclictest9-21ksoftirqd/023:44:550
1388699292,18cyclictest0-21swapper/021:05:240
13889992823,3cyclictest41-21ksoftirqd/319:16:093
1388899288,3cyclictest25989-21ls19:35:142
1388899287,20cyclictest18304-21kworker/2:021:45:412
13888992823,3cyclictest33-21ksoftirqd/223:27:042
13888992823,3cyclictest33-21ksoftirqd/222:30:102
13887992822,4cyclictest25-21ksoftirqd/123:20:091
13887992822,4cyclictest25-21ksoftirqd/121:49:311
13887992822,4cyclictest25-21ksoftirqd/119:46:201
13886992822,4cyclictest9-21ksoftirqd/000:34:490
13886992822,4cyclictest9-21ksoftirqd/000:34:490
13889992722,3cyclictest41-21ksoftirqd/323:50:153
13889992722,3cyclictest41-21ksoftirqd/323:35:533
13889992721,4cyclictest41-21ksoftirqd/320:51:203
13889992721,3cyclictest41-21ksoftirqd/322:20:113
1388899278,3cyclictest22464-21df20:35:132
1388899277,3cyclictest6807-21gzip22:15:232
1388899277,3cyclictest6807-21gzip22:15:232
1388799275,20cyclictest0-21swapper/123:28:011
13887992722,3cyclictest25-21ksoftirqd/121:40:071
13887992721,4cyclictest25-21ksoftirqd/120:35:021
13889992622,2cyclictest41-21ksoftirqd/321:00:183
13888992621,3cyclictest33-21ksoftirqd/200:21:082
1388899261,9cyclictest28361-21/usr/sbin/munin19:40:192
13887992621,3cyclictest25-21ksoftirqd/122:14:341
13887992621,3cyclictest25-21ksoftirqd/119:38:361
13886992621,3cyclictest9-21ksoftirqd/021:47:500
139391250,0ptp4l401ktimersoftd/321:35:123
13887992520,3cyclictest25-21ksoftirqd/122:21:071
13886992519,4cyclictest9-21ksoftirqd/020:07:530
13886992515,7cyclictest2518-21gnome-shell22:23:590
13886992414,6cyclictest2518-21gnome-shell22:25:590
13886992313,6cyclictest2518-21gnome-shell22:39:590
13886992312,8cyclictest4198-21/usr/sbin/munin19:55:210
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional