You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-30 - 22:08
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot3.osadl.org (updated Sun Nov 30, 2025 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1902919997235,35cyclictest1927222-21kworker/1:008:35:011
1902919996731,34cyclictest3901301-1kworker/1:0H10:59:591
1902919996637,28cyclictest1958188-21kworker/1:110:05:161
1902919996562,2cyclictest0-21swapper/111:51:191
1902919996543,21cyclictest1985087-1kworker/1:1H12:05:001
190291999650,64cyclictest0-21swapper/107:29:191
1902919996437,26cyclictest3901301-1kworker/1:0H10:50:191
1902919996360,2cyclictest0-21swapper/108:52:491
1902919996329,32cyclictest2004317-21kworker/1:012:15:161
1902919996235,26cyclictest1905565-21kworker/1:208:00:001
1902919996231,30cyclictest1958188-21kworker/1:110:35:161
1902919996231,30cyclictest1958188-21kworker/1:110:35:161
1902919996130,30cyclictest3901301-1kworker/1:0H11:15:161
1902925996044,13cyclictest1395319-1kworker/3:0H09:15:173
1902919996039,20cyclictest1985087-1kworker/1:1H12:30:141
1902919996034,25cyclictest1958188-21kworker/1:110:05:011
1902919996028,30cyclictest1953404-21kworker/1:309:40:121
190291999601,1cyclictest0-21swapper/109:05:131
1902919995943,15cyclictest1920177-21kworker/1:108:10:051
1902919995931,27cyclictest1985087-1kworker/1:1H12:25:061
1902919995929,29cyclictest1927222-21kworker/1:009:10:151
190291999590,56cyclictest0-21swapper/111:05:121
1902924995852,3cyclictest2483543-1kworker/2:1H11:20:512
1902919995843,14cyclictest1927222-21kworker/1:008:20:161
1902919995842,15cyclictest1976078-21kworker/1:011:25:151
1902919995842,15cyclictest1958188-21kworker/1:110:30:451
1902919995842,15cyclictest1953404-21kworker/1:309:45:061
1902919995842,15cyclictest1905565-21kworker/1:207:45:051
1902919995840,17cyclictest1927222-21kworker/1:008:40:161
1902919995839,17cyclictest1927222-21kworker/1:008:25:151
1902919995836,20cyclictest1985087-1kworker/1:1H12:05:531
1902919995741,15cyclictest2010656-21kworker/1:212:35:151
1902919995741,15cyclictest1976078-21kworker/1:011:14:201
1902919995741,15cyclictest1958188-21kworker/1:110:47:191
1902919995741,15cyclictest1927222-21kworker/1:009:20:141
1902919995741,15cyclictest1920177-21kworker/1:108:07:501
1902919995740,16cyclictest1997418-21kworker/1:211:55:161
1902919995740,16cyclictest1950698-21kworker/1:109:35:011
1902919995738,18cyclictest1905565-21kworker/1:207:15:471
1902919995734,22cyclictest1920177-21kworker/1:108:20:011
1902919995733,23cyclictest1958188-21kworker/1:109:55:161
1902919995648,7cyclictest0-21swapper/109:25:141
1902919995640,15cyclictest3901301-1kworker/1:0H08:00:231
1902919995640,15cyclictest1976078-21kworker/1:011:20:511
1902919995640,15cyclictest1905565-21kworker/1:207:35:161
1902919995640,15cyclictest1905565-21kworker/1:207:32:181
1902919995639,16cyclictest1958188-21kworker/1:110:15:011
1902919995635,20cyclictest3901301-1kworker/1:0H09:00:001
1902919995539,15cyclictest3901301-1kworker/1:0H11:04:191
1902919995539,15cyclictest2002298-21kworker/1:112:10:001
1902919995539,15cyclictest1989316-21kworker/1:211:30:141
1902919995538,16cyclictest1898542-21kworker/1:107:10:031
1902919995536,18cyclictest3901301-1kworker/1:0H10:15:071
1902919995534,19cyclictest3901301-1kworker/1:0H09:04:591
1902919995526,27cyclictest1958188-21kworker/1:110:40:141
190291999550,52cyclictest1935436-21cpuspeed_turbos08:45:141
1902925995448,4cyclictest1395319-1kworker/3:0H09:57:243
1902925995436,5cyclictest1395319-1kworker/3:0H09:50:163
1902925995436,3cyclictest1395319-1kworker/3:0H08:20:203
1902919995438,15cyclictest1958188-21kworker/1:109:51:181
1902919995437,16cyclictest1976078-21kworker/1:011:35:151
1902919995437,16cyclictest1958188-21kworker/1:110:25:181
1902919995437,16cyclictest1950698-21kworker/1:109:34:551
1902919995437,16cyclictest1905565-21kworker/1:207:50:151
1902919995437,16cyclictest1905565-21kworker/1:207:40:171
1902924995348,3cyclictest1951781-21kworker/2:112:14:182
1902919995341,10cyclictest1994782-21fschecks_count11:45:141
1902919995337,15cyclictest1958188-21kworker/1:110:24:491
1902919995336,16cyclictest1927222-21kworker/1:009:15:231
1902919995336,16cyclictest1927222-21kworker/1:008:35:011
1902925995247,3cyclictest1395319-1kworker/3:0H09:38:433
1902925995246,4cyclictest1395319-1kworker/3:0H09:24:443
1902925995236,2cyclictest1395319-1kworker/3:0H11:45:153
1902924995249,2cyclictest1916870-21kworker/2:108:06:062
1902924995248,2cyclictest2483543-1kworker/2:1H10:39:192
1902924995248,2cyclictest2483543-1kworker/2:1H10:39:192
1902924995247,3cyclictest2483543-1kworker/2:1H09:57:192
1902924995246,3cyclictest2483543-1kworker/2:1H07:50:142
1902919995236,15cyclictest1976078-21kworker/1:011:44:191
1902919995235,16cyclictest2004317-21kworker/1:012:20:141
1902925995145,4cyclictest1395319-1kworker/3:0H11:06:223
1902925995145,3cyclictest1395319-1kworker/3:0H11:23:443
1902925995144,5cyclictest1395319-1kworker/3:0H11:00:213
1902924995147,2cyclictest1951781-21kworker/2:110:59:192
1902924995146,3cyclictest2483543-1kworker/2:1H11:10:502
1902924995146,3cyclictest1951781-21kworker/2:110:49:542
1902924995143,5cyclictest2483543-1kworker/2:1H09:00:002
1902919995134,16cyclictest3901301-1kworker/1:0H07:21:241
1902925995045,3cyclictest1395319-1kworker/3:0H12:28:183
1902924995047,2cyclictest1951781-21kworker/2:110:24:442
1902924995046,3cyclictest1902828-21kworker/2:207:27:472
1902924995046,2cyclictest2483543-1kworker/2:1H11:50:132
1902925994944,3cyclictest1979306-21kworker/3:210:58:193
1902925994944,3cyclictest1395319-1kworker/3:0H09:10:463
1902925994943,3cyclictest1395319-1kworker/3:0H11:59:593
1902924994946,2cyclictest1951781-21kworker/2:110:51:492
1902924994946,2cyclictest1951781-21kworker/2:110:29:242
1902924994946,2cyclictest1916870-21kworker/2:108:28:242
1902924994945,3cyclictest1951781-21kworker/2:110:19:592
1902924994944,3cyclictest2483543-1kworker/2:1H11:36:442
1902918994944,3cyclictest1751615-1kworker/0:0H08:10:150
1902925994844,2cyclictest1929859-21kworker/3:008:45:123
1902925994843,3cyclictest1395319-1kworker/3:0H12:04:183
1902924994845,2cyclictest2483543-1kworker/2:1H09:30:222
1902924994845,2cyclictest1951781-21kworker/2:111:16:232
1902924994845,2cyclictest1951781-21kworker/2:109:35:562
1902924994845,2cyclictest1902828-21kworker/2:207:32:492
1902924994844,3cyclictest1933429-21kworker/2:208:49:542
1902924994844,2cyclictest1951781-21kworker/2:111:27:192
1902924994843,3cyclictest1902828-21kworker/2:207:36:502
1902925994744,2cyclictest1909841-21kworker/3:107:33:433
1902925994743,2cyclictest1395319-1kworker/3:0H12:10:453
1902925994743,2cyclictest1395319-1kworker/3:0H12:05:463
1902924994744,2cyclictest1933429-21kworker/2:209:02:182
1902924994743,3cyclictest1914752-21kworker/2:007:45:302
1902924994743,2cyclictest1916870-21kworker/2:108:17:062
1902924994743,2cyclictest1902828-21kworker/2:207:13:062
1902924994742,3cyclictest2483543-1kworker/2:1H11:33:172
1902924994742,3cyclictest1916870-21kworker/2:108:31:442
1902925994643,2cyclictest1963083-21kworker/3:210:39:553
1902925994643,2cyclictest1963083-21kworker/3:210:39:543
1902924994643,2cyclictest1951781-21kworker/2:112:27:182
1902924994642,2cyclictest1951781-21kworker/2:110:43:192
1902918994642,3cyclictest1751615-1kworker/0:0H11:40:010
1902918994641,3cyclictest1751615-1kworker/0:0H09:35:140
1902925994541,3cyclictest1395319-1kworker/3:0H11:35:583
1902925994539,3cyclictest1395319-1kworker/3:0H07:25:153
1902924994542,2cyclictest1951781-21kworker/2:112:24:442
1902924994542,2cyclictest1951781-21kworker/2:110:30:302
1902924994541,3cyclictest1951781-21kworker/2:109:46:072
1902924994541,3cyclictest1951781-21kworker/2:109:44:182
1902924994540,3cyclictest2483543-1kworker/2:1H10:05:402
1902924994540,3cyclictest1951781-21kworker/2:112:18:192
1902918994542,2cyclictest1751615-1kworker/0:0H09:21:490
1902918994540,2cyclictest1751615-1kworker/0:0H08:45:240
1902925994441,2cyclictest1395319-1kworker/3:0H07:35:243
1902925994440,2cyclictest1395319-1kworker/3:0H11:42:443
1902925994440,2cyclictest1395319-1kworker/3:0H10:44:453
1902925994439,3cyclictest1395319-1kworker/3:0H09:40:133
1902925994439,3cyclictest1395319-1kworker/3:0H08:07:443
1902925994439,3cyclictest1395319-1kworker/3:0H07:12:433
1902924994441,2cyclictest1951781-21kworker/2:112:31:042
1902924994441,2cyclictest1933429-21kworker/2:209:20:062
1902924994440,3cyclictest1951781-21kworker/2:112:39:432
1902924994440,3cyclictest1916870-21kworker/2:108:01:082
1902924994440,2cyclictest1951781-21kworker/2:110:04:502
1902924994439,2cyclictest2483543-1kworker/2:1H10:10:422
1902924994438,3cyclictest2483543-1kworker/2:1H08:20:202
1902918994442,1cyclictest1980940-21kworker/0:211:20:050
1902918994439,3cyclictest1896646-21kworker/0:007:29:350
1902918994439,2cyclictest1751615-1kworker/0:0H11:55:530
1902925994340,2cyclictest1989308-21kworker/3:011:29:563
1902925994339,3cyclictest1395319-1kworker/3:0H11:17:053
1902925994338,3cyclictest2010657-21kworker/3:012:35:013
1902925994338,3cyclictest1395319-1kworker/3:0H07:24:553
1902924994340,2cyclictest1951781-21kworker/2:111:01:192
1902924994340,2cyclictest1933429-21kworker/2:208:50:572
1902924994340,2cyclictest1902828-21kworker/2:207:41:182
1902924994340,2cyclictest1902828-21kworker/2:207:15:422
1902924994338,3cyclictest1916870-21kworker/2:108:36:432
1902924994337,2cyclictest1951781-21kworker/2:112:01:452
1902918994337,4cyclictest1751615-1kworker/0:0H08:50:250
1902918994337,3cyclictest1751615-1kworker/0:0H09:00:280
1902925994239,2cyclictest1923358-21kworker/3:208:25:163
1902925994239,2cyclictest1395319-1kworker/3:0H09:27:543
1902925994238,2cyclictest1395319-1kworker/3:0H08:35:003
1902924994239,2cyclictest1951781-21kworker/2:111:05:362
1902918994238,2cyclictest1913083-21kworker/0:208:29:440
1902918994238,2cyclictest1751615-1kworker/0:0H12:00:150
1902918994237,3cyclictest1751615-1kworker/0:0H10:15:140
1902925994138,2cyclictest1395319-1kworker/3:0H12:37:283
1902925994138,2cyclictest1395319-1kworker/3:0H09:48:183
1902925994138,2cyclictest1395319-1kworker/3:0H07:46:073
1902925994137,2cyclictest1929859-21kworker/3:008:55:483
1902925994137,2cyclictest1395319-1kworker/3:0H09:31:073
1902925994136,3cyclictest1395319-1kworker/3:0H11:13:253
1902925994136,3cyclictest1395319-1kworker/3:0H10:25:313
1902924994138,2cyclictest1902828-21kworker/2:207:22:192
1902924994137,3cyclictest2483543-1kworker/2:1H08:10:182
1902924994137,2cyclictest1951781-21kworker/2:111:40:322
1902924994136,3cyclictest2483543-1kworker/2:1H09:25:052
1902918994137,2cyclictest1751615-1kworker/0:0H11:10:160
1902918994137,2cyclictest1751615-1kworker/0:0H11:00:150
190291899413,10cyclictest1910907-21grep07:30:170
1902925994037,2cyclictest1395319-1kworker/3:0H11:50:223
1902925994037,2cyclictest1395319-1kworker/3:0H09:08:453
1902925994036,3cyclictest1395319-1kworker/3:0H08:38:443
1902925994036,2cyclictest1941725-21kworker/3:209:02:183
1902925994035,3cyclictest1395319-1kworker/3:0H08:40:483
1902925994035,2cyclictest1395319-1kworker/3:0H07:55:143
1902924994037,2cyclictest1951781-21kworker/2:111:56:282
1902924994035,3cyclictest2483543-1kworker/2:1H08:41:192
1902918994037,2cyclictest1751615-1kworker/0:0H07:10:060
1902918994036,2cyclictest1751615-1kworker/0:0H10:30:000
1902918994034,3cyclictest1751615-1kworker/0:0H12:20:540
1902925993936,2cyclictest1995805-21kworker/3:112:17:363
1902925993936,2cyclictest1963083-21kworker/3:210:15:533
1902925993936,2cyclictest1929859-21kworker/3:008:53:193
1902925993936,2cyclictest1909841-21kworker/3:107:50:533
1902925993936,2cyclictest1902763-21kworker/3:007:17:053
1902924993936,2cyclictest1933429-21kworker/2:209:13:432
1902924993935,3cyclictest2483543-1kworker/2:1H09:07:192
1902918993937,1cyclictest1913083-21kworker/0:208:00:460
1902918993936,2cyclictest1751615-1kworker/0:0H09:49:560
1902918993935,3cyclictest1751615-1kworker/0:0H07:48:180
1902918993934,3cyclictest1751615-1kworker/0:0H12:30:140
1902918993934,3cyclictest1751615-1kworker/0:0H07:40:000
1902918993933,3cyclictest1751615-1kworker/0:0H10:50:170
1902925993835,2cyclictest1395319-1kworker/3:0H10:33:473
1902925993834,2cyclictest1395319-1kworker/3:0H10:23:193
1902925993834,2cyclictest1395319-1kworker/3:0H08:04:353
1902925993832,4cyclictest1976067-21kworker/3:110:54:543
1902925993832,4cyclictest1395319-1kworker/3:0H10:45:313
1902925993832,3cyclictest1395319-1kworker/3:0H10:00:173
1902924993835,2cyclictest1951781-21kworker/2:112:09:502
1902924993835,2cyclictest1951781-21kworker/2:111:46:202
1902924993834,3cyclictest2483543-1kworker/2:1H09:19:482
1902918993835,2cyclictest1751615-1kworker/0:0H11:31:190
1902918993835,2cyclictest1751615-1kworker/0:0H08:21:200
1902918993734,2cyclictest1751615-1kworker/0:0H12:36:190
1902918993733,2cyclictest1751615-1kworker/0:0H10:00:410
1902918993732,3cyclictest1751615-1kworker/0:0H10:40:000
1902918993732,3cyclictest1751615-1kworker/0:0H10:40:000
1902918993731,3cyclictest1751615-1kworker/0:0H07:50:140
1902925993633,2cyclictest1989308-21kworker/3:011:34:553
1902925993633,2cyclictest1395319-1kworker/3:0H10:14:193
1902918993634,1cyclictest1896646-21kworker/0:007:40:140
1902918993633,2cyclictest1992614-21kworker/0:311:45:310
1902918993632,2cyclictest1943342-21kworker/0:009:14:190
1902918993632,2cyclictest1751615-1kworker/0:0H12:15:000
1902918993632,2cyclictest1751615-1kworker/0:0H09:30:350
1902918993632,2cyclictest1751615-1kworker/0:0H08:18:190
1902918993631,3cyclictest1751615-1kworker/0:0H10:20:430
1902925993530,3cyclictest1395319-1kworker/3:0H08:15:263
1902925993526,6cyclictest1395319-1kworker/3:0H07:44:443
1902924993532,2cyclictest2483543-1kworker/2:1H09:54:172
1902918993530,3cyclictest1751615-1kworker/0:0H11:30:010
1902918993529,4cyclictest1751615-1kworker/0:0H08:39:180
1902925993430,3cyclictest1395319-1kworker/3:0H12:21:433
1902925993428,3cyclictest1395319-1kworker/3:0H08:10:193
1902918993329,3cyclictest1751615-1kworker/0:0H10:50:000
1902918993329,2cyclictest1751615-1kworker/0:0H12:15:540
1902918993228,3cyclictest1943342-21kworker/0:009:55:010
1902918993228,2cyclictest1751615-1kworker/0:0H09:09:490
1902918993227,2cyclictest1751615-1kworker/0:0H12:25:560
1902918993226,3cyclictest1751615-1kworker/0:0H11:50:130
1902924993128,2cyclictest1916870-21kworker/2:107:55:512
1902918993126,3cyclictest1751615-1kworker/0:0H11:05:150
1902918993124,4cyclictest1751615-1kworker/0:0H08:05:150
1902918993026,2cyclictest1751615-1kworker/0:0H10:10:000
190291899296,14cyclictest1907599-21ls07:20:210
1902918992925,3cyclictest1751615-1kworker/0:0H10:55:210
1902925992824,3cyclictest1395319-1kworker/3:0H10:07:183
190291899283,5cyclictest0-21swapper/009:55:170
1902918992824,2cyclictest1906609-21munin-run07:20:010
1902919992722,3cyclictest0-21swapper/107:10:011
1902918992716,8cyclictest1986087-21basename11:20:010
1902918992623,2cyclictest1751615-1kworker/0:0H09:17:050
1902918992521,2cyclictest1953633-21apt-get09:40:100
1902918992521,2cyclictest1751615-1kworker/0:0H08:40:160
190291899251,15cyclictest1930383-21/usr/sbin/munin08:30:120
190291899247,5cyclictest1993271-21gltestperf11:40:180
190291899235,5cyclictest1964202-21ntpq10:10:190
1902918992318,3cyclictest1939862-21munin-run09:00:000
1902918992318,3cyclictest1920117-21cron08:00:000
1902918992316,5cyclictest1902946-21latency_hist07:10:000
1902918992216,4cyclictest0-21swapper/010:44:590
1902918992213,7cyclictest1971370-21latency_hist10:35:000
190291899220,15cyclictest53250irq/160-enp0s2912:05:130
1902918992114,4cyclictest1756130-21systemd-journal09:25:320
190292599190,13cyclictest1902788-21latency_hist07:10:003
190292499161,13cyclictest1902929-21latency_hist07:10:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional