You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-29 - 19:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot3.osadl.org (updated Sat Nov 29, 2025 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
166891999650,3cyclictest0-21swapper/109:23:551
1668919996145,15cyclictest1711274-21kworker/1:209:25:141
1668919996057,2cyclictest0-21swapper/111:39:321
1668919996042,16cyclictest1675812-21kworker/1:107:30:141
1668919996042,16cyclictest1675812-21kworker/1:107:30:141
1668919995841,16cyclictest1692570-21kworker/1:208:40:001
1668919995840,17cyclictest1667266-21kworker/1:207:15:011
1668919995839,18cyclictest1711274-21kworker/1:209:40:141
166891999580,1cyclictest0-21swapper/108:18:321
1668919995743,14cyclictest1667266-21kworker/1:207:24:291
1668919995742,14cyclictest1753447-21kworker/1:011:51:281
1668919995742,14cyclictest1743696-21kworker/1:111:25:001
1668919995742,14cyclictest1711274-21kworker/1:210:05:021
1668919995742,14cyclictest1711274-21kworker/1:209:50:161
1668919995742,14cyclictest1711274-21kworker/1:209:37:551
1668919995742,14cyclictest1677684-21kworker/1:008:09:551
1668919995740,17cyclictest1743696-21kworker/1:111:00:161
1668919995740,16cyclictest1764864-21kworker/1:312:10:181
1668919995740,16cyclictest1753447-21kworker/1:011:30:001
1668919995740,16cyclictest1692570-21kworker/1:208:35:001
1668919995740,16cyclictest1677684-21kworker/1:007:55:131
1668919995739,17cyclictest1764864-21kworker/1:312:00:181
1668919995739,17cyclictest1737001-21kworker/1:310:50:181
1668919995737,18cyclictest1737001-21kworker/1:310:40:161
1668919995642,14cyclictest1764864-21kworker/1:312:15:481
1668919995642,14cyclictest1677684-21kworker/1:007:48:351
1668919995642,14cyclictest1677684-21kworker/1:007:35:061
1668919995641,14cyclictest1764864-21kworker/1:312:20:171
1668919995641,14cyclictest1743696-21kworker/1:111:20:011
1668919995641,14cyclictest1711274-21kworker/1:209:55:171
1668919995641,14cyclictest1701289-21kworker/1:009:04:251
1668919995641,14cyclictest1701289-21kworker/1:009:04:241
1668919995641,14cyclictest1667266-21kworker/1:207:25:021
1668919995639,16cyclictest1701289-21kworker/1:009:05:171
1668919995638,16cyclictest1701289-21kworker/1:008:50:001
1668919995541,14cyclictest1725851-21kworker/1:110:00:221
1668919995541,14cyclictest1692570-21kworker/1:208:24:501
1668919995541,14cyclictest1677684-21kworker/1:007:50:351
1668919995540,14cyclictest1753447-21kworker/1:011:45:171
1668919995540,14cyclictest1753447-21kworker/1:011:40:201
1668919995540,14cyclictest1743696-21kworker/1:110:55:501
1668919995540,14cyclictest1701289-21kworker/1:009:10:351
1668919995540,14cyclictest1677684-21kworker/1:007:40:001
1668919995539,15cyclictest1692570-21kworker/1:208:25:181
1668919995537,17cyclictest1743696-21kworker/1:111:10:161
1668919995537,17cyclictest1677684-21kworker/1:008:00:171
1668927995449,3cyclictest1759944-21kworker/3:111:50:403
1668927995448,4cyclictest1395319-1kworker/3:0H10:45:003
1668927995448,3cyclictest1395319-1kworker/3:0H11:15:153
1668919995440,14cyclictest1743696-21kworker/1:111:20:151
1668919995440,14cyclictest1737001-21kworker/1:310:35:161
1668919995439,14cyclictest1773180-21kworker/1:112:30:181
1668919995439,14cyclictest1764864-21kworker/1:312:05:171
1668919995439,14cyclictest1737001-21kworker/1:310:45:161
1668919995439,14cyclictest1711274-21kworker/1:210:11:271
1668919995439,14cyclictest1701289-21kworker/1:008:55:051
1668919995437,16cyclictest1763776-21kworker/1:211:55:161
1668919995436,17cyclictest1711274-21kworker/1:210:20:161
1668919995433,19cyclictest1773180-21kworker/1:112:25:241
1668927995349,2cyclictest1683943-21kworker/3:008:20:483
1668919995339,14cyclictest1677684-21kworker/1:008:10:211
1668919995338,14cyclictest1711274-21kworker/1:209:45:151
1668919995337,15cyclictest1773180-21kworker/1:112:35:481
1668919995335,17cyclictest1667266-21kworker/1:207:15:001
1668919995334,17cyclictest1711274-21kworker/1:210:20:001
1668927995247,3cyclictest1759944-21kworker/3:112:21:533
1668922995249,2cyclictest427391-21kworker/2:008:26:262
1668922995249,2cyclictest1738639-21kworker/2:012:27:562
1668922995248,2cyclictest427391-21kworker/2:007:49:352
1668919995249,2cyclictest0-21swapper/111:07:271
1668919995237,14cyclictest3881054-1kworker/1:2H08:40:151
1668919995237,14cyclictest1711274-21kworker/1:210:25:161
1668919995237,14cyclictest1711274-21kworker/1:209:15:261
1668914995249,2cyclictest1695817-21kworker/0:008:44:520
1668914995248,2cyclictest1695817-21kworker/0:008:50:340
1668927995146,3cyclictest1395319-1kworker/3:0H12:35:483
1668927995146,3cyclictest1395319-1kworker/3:0H12:05:443
1668922995148,2cyclictest1738639-21kworker/2:012:10:582
1668922995147,3cyclictest427391-21kworker/2:007:20:382
1668922995147,2cyclictest1707497-21kworker/2:109:31:242
1668919995136,14cyclictest1701289-21kworker/1:008:50:011
1668919995135,15cyclictest3881054-1kworker/1:2H09:30:051
166891999510,49cyclictest0-21swapper/110:32:561
166891999510,49cyclictest0-21swapper/110:32:561
1668914995147,2cyclictest1748320-21kworker/0:211:35:260
1668927995045,3cyclictest1695824-21kworker/3:108:40:403
1668927995045,3cyclictest1395319-1kworker/3:0H12:00:163
1668927995038,2cyclictest1720721-21kworker/3:010:16:563
1668922995047,2cyclictest1703981-21kworker/2:009:05:252
1668914995045,3cyclictest2841348-1kworker/0:1H08:26:200
1668914995045,3cyclictest1682334-21kworker/0:208:19:500
1668914995044,4cyclictest2841348-1kworker/0:1H07:30:080
1668914995044,4cyclictest2841348-1kworker/0:1H07:30:070
1668927994946,2cyclictest1754818-21kworker/3:011:37:253
1668927994945,2cyclictest1774547-21kworker/3:012:30:343
1668927994944,3cyclictest1695824-21kworker/3:108:32:463
1668922994945,2cyclictest1703981-21kworker/2:009:00:062
1668922994945,2cyclictest1703981-21kworker/2:009:00:062
1668922994944,3cyclictest1707497-21kworker/2:109:21:492
1668927994845,2cyclictest1749931-21kworker/3:211:23:513
1668927994845,2cyclictest1707434-21kworker/3:009:25:313
1668927994844,2cyclictest1720721-21kworker/3:010:26:203
1668922994845,2cyclictest1700742-21kworker/2:308:45:052
1668914994845,2cyclictest1723957-21kworker/0:010:01:550
1668914994845,2cyclictest1695817-21kworker/0:008:48:210
1668914994845,2cyclictest1682334-21kworker/0:208:23:520
1668914994844,2cyclictest1715853-21kworker/0:109:51:290
1668914994844,2cyclictest1715853-21kworker/0:109:45:060
1668914994843,3cyclictest2841348-1kworker/0:1H07:10:220
1668914994843,3cyclictest1751615-1kworker/0:0H12:35:230
1668914994843,3cyclictest1751615-1kworker/0:0H12:05:220
1668914994842,4cyclictest2841348-1kworker/0:1H07:44:440
1668914994841,4cyclictest2841348-1kworker/0:1H07:45:140
1668927994744,2cyclictest1759944-21kworker/3:111:58:253
1668927994744,2cyclictest1707434-21kworker/3:009:17:063
1668927994743,3cyclictest1720721-21kworker/3:010:09:273
1668927994743,3cyclictest1683943-21kworker/3:008:28:273
1668927994742,3cyclictest1703921-21kworker/3:109:05:453
1668927994741,3cyclictest1395319-1kworker/3:0H11:05:143
1668927994740,4cyclictest1395319-1kworker/3:0H07:49:453
1668922994744,2cyclictest2483543-1kworker/2:1H10:59:512
1668922994744,2cyclictest2483543-1kworker/2:1H09:48:492
1668922994744,2cyclictest1738639-21kworker/2:012:18:252
1668922994741,4cyclictest2483543-1kworker/2:1H07:25:152
1668914994744,2cyclictest1756753-21kworker/0:312:02:560
1668914994744,2cyclictest1732070-21kworker/0:011:09:260
1668914994744,2cyclictest1728829-21kworker/0:110:15:230
1668914994744,2cyclictest1728829-21kworker/0:110:10:150
1668914994744,2cyclictest1686016-21kworker/0:108:04:540
1668914994742,3cyclictest1715853-21kworker/0:109:35:160
1668914994736,2cyclictest1732070-21kworker/0:011:04:510
1668927994643,2cyclictest1738568-21kworker/3:010:38:513
1668927994643,2cyclictest1725580-21kworker/3:209:58:253
1668927994642,3cyclictest1715861-21kworker/3:109:31:133
1668927994642,3cyclictest1395319-1kworker/3:0H08:05:173
1668927994642,2cyclictest1395319-1kworker/3:0H07:54:453
1668927994641,3cyclictest1707434-21kworker/3:009:21:153
1668927994640,4cyclictest1743444-21kworker/3:111:05:003
1668922994643,2cyclictest2483543-1kworker/2:1H10:22:512
1668922994643,2cyclictest2483543-1kworker/2:1H10:15:252
1668922994643,2cyclictest2483543-1kworker/2:1H08:44:472
1668922994642,3cyclictest2483543-1kworker/2:1H12:34:512
1668922994642,2cyclictest2483543-1kworker/2:1H08:30:142
1668922994641,3cyclictest2483543-1kworker/2:1H11:01:512
1668922994639,5cyclictest2483543-1kworker/2:1H12:08:522
1668914994643,2cyclictest1682334-21kworker/0:207:54:380
1668927994542,2cyclictest1769663-21kworker/3:012:14:013
1668927994542,2cyclictest1754818-21kworker/3:011:31:323
1668927994542,2cyclictest1720721-21kworker/3:010:30:273
1668927994542,2cyclictest1720721-21kworker/3:010:30:273
1668927994542,2cyclictest1668729-21kworker/3:007:15:383
1668927994541,2cyclictest1720721-21kworker/3:010:14:023
1668927994540,3cyclictest1756690-21kworker/3:211:41:583
1668927994540,3cyclictest1395319-1kworker/3:0H11:25:173
1668927994540,3cyclictest1395319-1kworker/3:0H07:35:193
1668922994542,2cyclictest2483543-1kworker/2:1H11:42:542
1668922994542,2cyclictest2483543-1kworker/2:1H07:33:002
1668922994542,2cyclictest2483543-1kworker/2:1H07:33:002
1668922994541,3cyclictest2483543-1kworker/2:1H10:00:062
1668922994541,3cyclictest2483543-1kworker/2:1H08:04:372
1668922994540,3cyclictest1738639-21kworker/2:011:09:322
1668922994539,4cyclictest2483543-1kworker/2:1H11:54:512
1668914994543,1cyclictest1732070-21kworker/0:010:24:250
1668914994542,2cyclictest1748320-21kworker/0:211:16:080
1668914994542,2cyclictest1740209-21kworker/0:210:53:510
1668914994542,2cyclictest1735332-21kworker/0:210:37:260
1668914994542,2cyclictest1695817-21kworker/0:008:33:440
1668914994542,2cyclictest1676062-21kworker/0:107:38:350
1668914994541,2cyclictest1751615-1kworker/0:0H12:30:010
1668927994440,2cyclictest1699720-21kworker/3:008:48:533
1668927994440,2cyclictest1695824-21kworker/3:108:36:513
1668927994440,2cyclictest1672544-21kworker/3:107:26:203
1668927994439,3cyclictest1720721-21kworker/3:009:49:513
1668927994439,3cyclictest1703921-21kworker/3:109:01:283
1668927994439,3cyclictest1703921-21kworker/3:109:01:283
1668927994439,3cyclictest1675805-21kworker/3:307:33:353
1668927994439,3cyclictest1675805-21kworker/3:307:33:343
1668922994440,3cyclictest2483543-1kworker/2:1H11:31:252
1668922994440,3cyclictest2483543-1kworker/2:1H08:21:262
1668922994439,3cyclictest2483543-1kworker/2:1H11:35:172
1668922994438,4cyclictest2483543-1kworker/2:1H08:55:232
1668914994441,2cyclictest1723957-21kworker/0:009:55:530
1668914994440,2cyclictest1668738-21kworker/0:007:22:190
1668914994439,3cyclictest2841348-1kworker/0:1H09:15:050
1668914994439,3cyclictest1768056-21kworker/0:112:12:270
1668927994340,2cyclictest1738568-21kworker/3:010:50:463
1668927994340,2cyclictest1738568-21kworker/3:010:48:023
1668927994340,2cyclictest1683943-21kworker/3:007:59:463
1668927994340,2cyclictest1395319-1kworker/3:0H08:14:553
1668927994339,2cyclictest1720721-21kworker/3:010:02:483
1668927994338,3cyclictest1715861-21kworker/3:109:41:543
1668927994338,3cyclictest1703921-21kworker/3:108:55:113
1668927994338,3cyclictest1395319-1kworker/3:0H08:00:073
1668922994339,2cyclictest2483543-1kworker/2:1H08:35:542
1668922994338,4cyclictest2483543-1kworker/2:1H11:25:002
1668922994338,2cyclictest2483543-1kworker/2:1H10:10:162
1668922994337,4cyclictest2483543-1kworker/2:1H12:40:002
1668914994341,1cyclictest1703920-21kworker/0:209:09:550
1668914994340,2cyclictest1715853-21kworker/0:109:41:240
1668914994339,3cyclictest1751615-1kworker/0:0H11:50:230
1668914994339,3cyclictest1748320-21kworker/0:211:40:180
1668914994338,3cyclictest1751615-1kworker/0:0H11:55:160
1668914994337,4cyclictest2841348-1kworker/0:1H10:30:140
1668914994337,4cyclictest2841348-1kworker/0:1H10:30:140
1668914994337,4cyclictest2841348-1kworker/0:1H08:10:210
1668927994239,2cyclictest1743444-21kworker/3:111:10:073
1668927994239,2cyclictest1719085-21kworker/3:209:36:553
1668927994239,2cyclictest1707434-21kworker/3:009:10:073
1668922994238,2cyclictest2483543-1kworker/2:1H07:36:132
1668922994237,3cyclictest2483543-1kworker/2:1H12:03:512
1668922994237,3cyclictest2483543-1kworker/2:1H09:15:142
1668922994237,3cyclictest1738639-21kworker/2:011:55:152
1668922994236,3cyclictest2483543-1kworker/2:1H11:20:012
1668922994236,3cyclictest2483543-1kworker/2:1H08:09:472
1668914994239,2cyclictest1771297-21kworker/0:112:20:530
1668914994239,2cyclictest1756753-21kworker/0:311:47:250
1668914994239,2cyclictest1748320-21kworker/0:211:25:530
1668914994238,2cyclictest2841348-1kworker/0:1H07:15:150
1668914994235,4cyclictest2841348-1kworker/0:1H07:25:150
1668927994137,3cyclictest1670386-21kworker/3:207:12:463
1668927994137,3cyclictest1395319-1kworker/3:0H08:54:483
1668914994138,2cyclictest1748320-21kworker/0:211:14:020
1668922994035,3cyclictest427391-21kworker/2:007:44:592
1668922994035,3cyclictest2483543-1kworker/2:1H10:07:512
1668914994037,2cyclictest1715853-21kworker/0:109:33:540
1668914994036,3cyclictest2841348-1kworker/0:1H10:40:420
1668914994036,2cyclictest1703920-21kworker/0:209:23:490
1668927993936,2cyclictest1759944-21kworker/3:112:19:503
1668927993936,2cyclictest1675805-21kworker/3:307:40:283
1668927993935,2cyclictest1738568-21kworker/3:010:56:593
1668922993933,4cyclictest2483543-1kworker/2:1H09:25:262
1668914993936,2cyclictest2841348-1kworker/0:1H10:45:250
1668927993834,3cyclictest1759944-21kworker/3:112:25:583
1668922993833,3cyclictest2483543-1kworker/2:1H09:40:142
1668922993833,2cyclictest2483543-1kworker/2:1H10:35:162
1668914993836,1cyclictest1695817-21kworker/0:008:37:220
1668914993835,2cyclictest1703920-21kworker/0:209:10:140
1668922993733,3cyclictest2483543-1kworker/2:1H10:30:572
1668922993733,3cyclictest2483543-1kworker/2:1H10:30:572
1668922993733,3cyclictest2483543-1kworker/2:1H09:10:342
1668922993733,3cyclictest2483543-1kworker/2:1H08:15:062
1668914993734,2cyclictest1740209-21kworker/0:210:55:340
166891499372,24cyclictest1714514-21apt-get09:25:120
1668927993632,3cyclictest1759944-21kworker/3:111:45:393
1668927993632,2cyclictest1395319-1kworker/3:0H07:20:163
1668914993633,2cyclictest1769672-21kworker/0:212:15:450
1668914993632,2cyclictest2841348-1kworker/0:1H08:55:150
1668914993631,3cyclictest2841348-1kworker/0:1H09:00:160
1668914993631,3cyclictest2841348-1kworker/0:1H09:00:160
1668922993530,3cyclictest2483543-1kworker/2:1H10:45:282
1668914993529,3cyclictest1771297-21kworker/0:112:31:560
1668927993431,2cyclictest1720721-21kworker/3:010:23:263
1668922993430,2cyclictest2483543-1kworker/2:1H07:15:012
1668922993429,3cyclictest2483543-1kworker/2:1H12:23:512
1668922993429,3cyclictest2483543-1kworker/2:1H11:30:012
1668914993429,3cyclictest1732070-21kworker/0:010:26:030
1668914993330,2cyclictest1748320-21kworker/0:211:31:090
1668914993330,2cyclictest1682334-21kworker/0:208:05:510
1668927993229,2cyclictest1723960-21kworker/3:109:52:243
1668927993128,2cyclictest1683943-21kworker/3:008:18:573
1668922993126,3cyclictest2483543-1kworker/2:1H11:45:292
1668922993126,3cyclictest2483543-1kworker/2:1H07:12:202
166891999311,28cyclictest1669011-21latency_hist07:10:001
1668914993128,2cyclictest1723957-21kworker/0:010:07:560
1668922992924,4cyclictest2483543-1kworker/2:1H09:55:402
166892299291,23cyclictest0-21swapper/207:55:122
1668922992823,3cyclictest2483543-1kworker/2:1H11:10:182
166891499287,19cyclictest1752948-21sed11:20:210
166892299270,2cyclictest151rcu_preempt09:55:012
1668922992621,3cyclictest2483543-1kworker/2:1H07:50:182
166892299261,16cyclictest1734287-21/usr/sbin/munin10:25:162
1668914992520,4cyclictest1685233-21sensors07:55:190
166892299240,16cyclictest1742806-21/usr/sbin/munin10:50:182
166892299230,12cyclictest1740251-21basename10:45:002
166892299226,10cyclictest0-21swapper/208:10:142
166892299205,9cyclictest1703224-21latency08:50:182
166892299202,9cyclictest1717750-21apt-get09:35:142
166892299142,9cyclictest0-21swapper/207:09:592
166892799122,5cyclictest0-21swapper/307:09:593
166891499102,6cyclictest1668917-21latency_hist07:10:000
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional