You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-30 - 11:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot2s.osadl.org (updated Tue Jun 30, 2026 00:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1818981997063,4cyclictest86-21hwrng23:33:003
1818980996357,3cyclictest0-21swapper/220:11:162
1818980996053,4cyclictest0-21swapper/222:22:212
1818980996051,5cyclictest0-21swapper/223:19:412
1818980996051,5cyclictest0-21swapper/223:19:412
1818978995931,7cyclictest1860885-21ntpq21:15:400
1818978995931,7cyclictest1860885-21ntpq21:15:400
1818980995750,4cyclictest0-21swapper/223:11:302
1818981995547,5cyclictest86-21hwrng21:56:453
1818981995547,5cyclictest86-21hwrng21:56:453
181897899551,50cyclictest1865807-21apt-get21:24:580
1818978995220,23cyclictest1939162-21ssh23:30:040
181897899521,42cyclictest1937065-21ssh23:25:300
181897899521,40cyclictest1869634-21ssh21:30:340
181898199512,21cyclictest1936194-21ssh23:24:573
1818980995144,4cyclictest0-21swapper/219:09:502
181897899511,41cyclictest1904953-21ntpq22:30:360
1818978995018,27cyclictest1847264-21sendmail-msp20:40:010
181897899501,45cyclictest1974776-21ssh00:30:190
181897899491,42cyclictest1907990-21ssh22:35:440
1818981994818,20cyclictest1907800-21ntpq22:35:273
1818978994820,23cyclictest1890148-21ntpq22:05:350
1818978994819,24cyclictest1959689-21ssh00:05:110
1818978994819,24cyclictest1959689-21ssh00:05:110
181897899481,43cyclictest1862020-21kworker/u16:8+xprtiod21:40:140
181897899481,28cyclictest1913765-21ssh22:45:350
181897899481,19cyclictest1933076-21ssh23:19:460
181897899481,19cyclictest1933076-21ssh23:19:460
181897899481,18cyclictest1918721-21ssh22:55:060
181897899481,18cyclictest1918721-21ssh22:55:060
181897899471,42cyclictest1878373-21ssh21:45:300
181897899471,42cyclictest1878373-21ssh21:45:300
181897899471,42cyclictest1872603-21ssh21:35:320
181897899471,41cyclictest1950862-21ssh23:50:030
181897899471,16cyclictest1827051-21apt-get19:34:590
1818981994628,15cyclictest0-21swapper/320:15:053
181898199461,19cyclictest1972338-21ntpq00:25:373
181898199461,19cyclictest1863811-21ntpq21:20:433
1818978994634,9cyclictest86-21hwrng21:50:360
1818978994634,9cyclictest86-21hwrng21:50:360
181897899461,41cyclictest1902038-21ntpq22:25:390
181897899461,40cyclictest1946534-21/usr/sbin/munin23:41:120
181897899461,31cyclictest1892838-21irqstats22:10:210
181897899461,18cyclictest1977257-21ssh00:34:510
181897899461,17cyclictest1842761-21munin-node20:24:570
181897899461,15cyclictest1857966-21ntpq21:10:410
181897899461,15cyclictest1857966-21ntpq21:10:410
1818981994521,21cyclictest0-21swapper/320:55:303
1818981994520,5cyclictest511ktimers/323:41:013
1818981994520,18cyclictest1881313-21ssh21:50:283
1818981994520,18cyclictest1881313-21ssh21:50:283
1818981994518,22cyclictest1930375-21ssh23:14:583
1818981994518,22cyclictest1930375-21ssh23:14:583
1818981994516,20cyclictest1868771-21ssh21:30:123
181898199451,38cyclictest1969343-21ntpq00:20:403
1818980994538,4cyclictest0-21swapper/223:20:432
1818980994534,8cyclictest0-21swapper/223:32:252
1818978994514,27cyclictest1925395-21ntpq23:05:430
181897899451,40cyclictest1954685-21ssh23:55:310
181897899451,40cyclictest1910964-21ntp_states22:41:010
181897899451,40cyclictest1910964-21ntp_states22:41:010
181897899451,40cyclictest1883477-21aten_r8power_cu21:55:130
181897899451,40cyclictest1883477-21aten_r8power_cu21:55:130
181897899451,40cyclictest1851460-21ntpq20:50:400
181897899451,39cyclictest1824494-21/usr/sbin/munin19:25:220
181897899451,39cyclictest1824494-21/usr/sbin/munin19:25:220
181897899451,18cyclictest1921591-21ssh22:59:510
181897899451,18cyclictest1921591-21ssh22:59:510
181897899451,17cyclictest1972110-21memory00:25:250
181898199442,32cyclictest1966134-21irqstats00:15:183
1818981994421,18cyclictest1872540-21ntpq21:35:273
1818981994419,21cyclictest1978191-21/usr/sbin/munin00:35:363
1818979994438,3cyclictest0-21swapper/122:30:411
181897899443,36cyclictest1838763-21ntpq20:10:250
1818978994420,20cyclictest1969105-21ssh00:20:290
1818978994420,19cyclictest1759-21snmpd19:45:250
1818978994419,21cyclictest1947906-21ssh23:45:030
1818978994419,21cyclictest1849881-21ntpq20:45:440
1818978994417,22cyclictest1965835-21df00:15:120
1818978994416,24cyclictest1916655-21ntpq22:50:340
1818978994414,21cyclictest1942764-21memory23:35:240
1818978994414,21cyclictest1942764-21memory23:35:240
181897899441,39cyclictest1834689-21sendmail-msp20:00:130
181897899441,39cyclictest1832017-21/usr/sbin/munin19:50:140
181897899441,38cyclictest1959358-21munin-run00:04:450
181897899441,23cyclictest1855104-21sshd-session21:03:250
181897899441,17cyclictest1899052-21sh22:20:400
181897899441,17cyclictest1839608-21sort20:14:540
181897899441,14cyclictest1852422-21/usr/sbin/munin20:55:130
1818981994323,17cyclictest0-21swapper/320:30:373
1818981994322,19cyclictest0-21swapper/321:10:243
1818981994322,19cyclictest0-21swapper/321:10:243
1818981994322,18cyclictest0-21swapper/322:15:303
1818981994321,20cyclictest0-21swapper/300:10:383
1818981994321,18cyclictest1923890-21ssh23:03:383
1818981994321,18cyclictest1923890-21ssh23:03:383
1818981994320,18cyclictest1899073-21ntpq22:20:423
1818981994318,20cyclictest1893252-21ssh22:10:433
1818981994317,22cyclictest1889282-21ssh22:05:073
181898199431,23cyclictest1874394-21apt-get21:40:113
1818978994318,21cyclictest1928293-21ssh23:10:300
1818978994318,21cyclictest1863957-21ntp_states21:20:590
181897899431,38cyclictest1825991-21irqstats19:30:170
181897899431,14cyclictest1934237-21ntpq23:20:450
1818981994226,14cyclictest511ktimers/323:50:383
1818981994223,16cyclictest0-21swapper/323:55:193
1818981994223,16cyclictest0-21swapper/322:01:303
1818981994223,16cyclictest0-21swapper/319:21:093
1818981994223,15cyclictest1902089-21ssh22:25:433
1818981994222,18cyclictest0-21swapper/320:00:503
1818981994221,18cyclictest0-21swapper/323:45:363
1818981994221,18cyclictest0-21swapper/321:00:463
1818981994219,20cyclictest511ktimers/323:21:013
1818981994219,18cyclictest1916535-21/usr/sbin/munin22:50:263
1818981994218,20cyclictest1960787-21/usr/sbin/munin00:05:533
1818981994218,20cyclictest1960787-21/usr/sbin/munin00:05:533
1818981994218,20cyclictest1865905-21ssh21:25:243
181898199421,35cyclictest1927626-21/usr/sbin/munin23:10:133
181898199421,35cyclictest1821609-21ntpq19:15:433
1818978994218,20cyclictest1897444-21rm22:18:140
1818978994216,22cyclictest1963207-21ssh00:10:230
181897899421,37cyclictest1841994-21ntpq20:20:410
181897899421,36cyclictest1886107-21sendmail-msp22:00:200
181897899421,16cyclictest1828877-21/usr/sbin/munin19:40:180
1818981994131,7cyclictest0-21swapper/319:25:473
1818981994131,7cyclictest0-21swapper/319:25:473
1818981994127,9cyclictest0-21swapper/319:10:173
181898199412,25cyclictest1911485-21ssh22:41:133
181898199412,25cyclictest1911485-21ssh22:41:133
1818981994121,16cyclictest1829356-21/usr/sbin/munin19:40:493
1818981994120,17cyclictest1904894-21ssh22:30:313
1818981994119,18cyclictest1877506-21apt-get21:45:113
1818981994119,18cyclictest1877506-21apt-get21:45:113
1818981994119,18cyclictest1856161-21ntpq21:05:333
1818981994119,18cyclictest1856161-21ntpq21:05:333
1818981994117,20cyclictest1925520-21ssh23:05:543
1818981994117,20cyclictest1859960-21ssh21:15:033
1818981994117,20cyclictest1859960-21ssh21:15:033
1818978994119,18cyclictest1834036-21/usr/sbin/munin19:55:220
1818978994118,18cyclictest1856135-21awk21:05:310
1818978994118,18cyclictest1856135-21awk21:05:310
1818978994115,22cyclictest1845082-21ntpq20:30:270
1818981994029,8cyclictest0-21swapper/320:40:213
1818981994022,13cyclictest0-21swapper/320:10:123
1818981994019,17cyclictest1913851-21/usr/sbin/munin22:45:423
1818981994019,17cyclictest1851348-21ntpq20:50:263
1818981994017,19cyclictest1974655-21/usr/sbin/munin00:30:153
181898199401,35cyclictest1843580-21ntpq20:25:453
181898199401,20cyclictest1919615-21ssh22:55:353
181898199401,20cyclictest1919615-21ssh22:55:353
1818980994034,3cyclictest0-21swapper/223:38:262
1818980994034,3cyclictest0-21swapper/223:38:262
1818979994033,4cyclictest0-21swapper/121:10:411
1818979994033,4cyclictest0-21swapper/121:10:411
181897899401,35cyclictest1821011-21diskstats19:15:150
181897899401,13cyclictest1822371-21aten_r8power_cu19:20:150
181897899401,12cyclictest1846717-21ntpq20:35:330
181897899401,12cyclictest1846717-21ntpq20:35:330
1818981993928,8cyclictest0-21swapper/320:05:433
1818981993927,9cyclictest0-21swapper/300:00:363
1818981993924,11cyclictest0-21swapper/319:54:563
1818981993919,16cyclictest1846654-21ntpq20:35:263
1818981993919,16cyclictest1846654-21ntpq20:35:263
1818981993918,18cyclictest1832527-21ntpq19:50:303
1818981993917,18cyclictest1830929-21ntpq19:45:233
1818981993914,21cyclictest1826825-21apt-get19:34:453
181898199391,17cyclictest1842002-21ntpq20:20:423
1818980993932,4cyclictest0-21swapper/220:19:282
1818978993916,19cyclictest1837312-21ntpq20:05:360
1818981993825,10cyclictest0-21swapper/320:45:303
1818980993831,4cyclictest0-21swapper/221:51:372
1818980993831,4cyclictest0-21swapper/221:51:372
1818980993824,10cyclictest0-21swapper/222:00:022
1818979993832,3cyclictest0-21swapper/100:08:451
1818979993832,3cyclictest0-21swapper/100:08:451
1818978993810,20cyclictest62-21kcompactd019:09:490
1818981993727,8cyclictest0-21swapper/323:35:153
1818981993727,8cyclictest0-21swapper/323:35:153
1818981993718,17cyclictest0-21swapper/319:35:293
1818980993731,4cyclictest0-21swapper/220:43:012
1818980993723,8cyclictest0-21swapper/221:40:512
1818979993730,3cyclictest0-21swapper/123:20:451
1818979993630,3cyclictest0-21swapper/122:40:001
1818979993630,3cyclictest0-21swapper/122:40:001
1818980993529,3cyclictest0-21swapper/223:00:122
1818980993529,3cyclictest0-21swapper/223:00:122
1818980993529,3cyclictest0-21swapper/200:00:252
1818979993529,3cyclictest0-21swapper/123:55:301
1818979993528,4cyclictest0-21swapper/121:45:191
1818979993528,4cyclictest0-21swapper/121:45:191
1818979993527,4cyclictest0-21swapper/100:35:031
1818979993526,5cyclictest0-21swapper/120:15:071
181897899351,19cyclictest1818982-21http19:09:460
1818980993424,6cyclictest0-21swapper/221:25:002
1818979993428,4cyclictest0-21swapper/123:05:041
1818979993427,4cyclictest0-21swapper/122:25:401
1818979993427,4cyclictest0-21swapper/122:05:461
1818979993427,3cyclictest0-21swapper/121:25:101
1818979993426,4cyclictest0-21swapper/123:50:161
1818979993425,5cyclictest0-21swapper/100:30:341
1818979993425,5cyclictest0-21swapper/100:14:541
1818979993425,4cyclictest0-21swapper/121:30:021
1818979993424,4cyclictest0-21swapper/119:09:491
1818980993327,3cyclictest0-21swapper/223:52:462
1818980993327,3cyclictest0-21swapper/219:40:132
1818980993326,4cyclictest0-21swapper/221:00:012
1818980993326,4cyclictest0-21swapper/220:00:152
1818979993327,3cyclictest0-21swapper/123:40:031
1818979993326,4cyclictest0-21swapper/123:35:091
1818979993326,4cyclictest0-21swapper/123:35:091
1818979993326,4cyclictest0-21swapper/122:49:451
1818979993326,4cyclictest0-21swapper/121:41:241
1818979993326,3cyclictest0-21swapper/123:10:541
1818979993325,4cyclictest0-21swapper/122:54:591
1818979993325,4cyclictest0-21swapper/122:54:591
1818979993325,4cyclictest0-21swapper/122:00:551
1818979993325,4cyclictest0-21swapper/120:44:561
1818979993325,3cyclictest0-21swapper/122:50:111
1818980993226,3cyclictest0-21swapper/220:45:082
1818980993224,5cyclictest0-21swapper/223:05:032
1818980993223,5cyclictest0-21swapper/219:55:092
1818980993222,6cyclictest0-21swapper/222:55:012
1818980993222,6cyclictest0-21swapper/222:55:012
1818980993221,5cyclictest0-21swapper/221:30:422
1818980993220,7cyclictest0-21swapper/223:40:452
1818980993220,6cyclictest0-21swapper/222:35:202
1818979993226,3cyclictest0-21swapper/121:50:191
1818979993226,3cyclictest0-21swapper/121:50:191
1818979993226,3cyclictest0-21swapper/121:03:251
1818979993226,3cyclictest0-21swapper/100:25:161
1818979993226,3cyclictest0-21swapper/100:22:401
1818979993225,4cyclictest0-21swapper/122:35:421
1818979993225,4cyclictest0-21swapper/119:45:251
1818979993225,3cyclictest0-21swapper/123:45:061
1818979993225,3cyclictest0-21swapper/123:15:391
1818979993225,3cyclictest0-21swapper/123:15:391
1818979993224,4cyclictest0-21swapper/123:25:091
1818979993224,4cyclictest0-21swapper/122:20:521
1818979993224,4cyclictest0-21swapper/121:35:141
1818979993224,4cyclictest0-21swapper/121:20:301
1818979993223,5cyclictest0-21swapper/119:20:021
1818980993126,3cyclictest0-21swapper/220:55:182
1818980993125,3cyclictest0-21swapper/223:45:192
1818980993125,3cyclictest0-21swapper/220:19:542
1818980993124,4cyclictest0-21swapper/200:10:502
1818980993123,5cyclictest0-21swapper/222:30:152
1818979993125,3cyclictest0-21swapper/120:20:331
1818979993125,3cyclictest0-21swapper/100:00:481
1818979993124,4cyclictest0-21swapper/121:55:241
1818979993124,4cyclictest0-21swapper/121:55:241
1818979993124,4cyclictest0-21swapper/120:44:481
1818979993124,4cyclictest0-21swapper/100:10:311
1818979993124,3cyclictest0-21swapper/122:14:591
1818979993124,3cyclictest0-21swapper/121:15:431
1818979993124,3cyclictest0-21swapper/121:15:431
1818979993124,3cyclictest0-21swapper/120:05:111
1818979993123,4cyclictest0-21swapper/123:30:061
1818979993123,4cyclictest0-21swapper/123:00:411
1818979993123,4cyclictest0-21swapper/123:00:411
1818979993123,4cyclictest0-21swapper/119:39:451
1818979993123,3cyclictest0-21swapper/120:09:571
1818979993122,5cyclictest0-21swapper/120:50:191
181898199304,21cyclictest50-21rcuc/319:09:483
1818980993025,3cyclictest0-21swapper/221:20:382
1818980993024,3cyclictest0-21swapper/222:39:572
1818980993024,3cyclictest0-21swapper/222:39:572
1818980993024,3cyclictest0-21swapper/221:15:382
1818980993024,3cyclictest0-21swapper/221:15:382
1818980993024,3cyclictest0-21swapper/219:25:222
1818980993024,3cyclictest0-21swapper/219:25:222
1818980993024,3cyclictest0-21swapper/200:20:282
1818980993023,4cyclictest0-21swapper/221:14:382
1818980993023,4cyclictest0-21swapper/221:14:382
1818980993022,5cyclictest0-21swapper/200:05:272
1818980993022,5cyclictest0-21swapper/200:05:272
1818980993022,4cyclictest0-21swapper/222:25:202
1818980993015,8cyclictest0-21swapper/219:34:572
1818979993024,3cyclictest0-21swapper/122:10:211
1818979993024,3cyclictest0-21swapper/119:09:471
1818979993023,4cyclictest0-21swapper/120:30:391
1818979993023,4cyclictest0-21swapper/119:25:171
1818979993023,4cyclictest0-21swapper/119:25:171
1818979993023,3cyclictest0-21swapper/120:55:151
1818979993022,4cyclictest0-21swapper/121:09:461
1818979993022,4cyclictest0-21swapper/121:09:461
1818979993022,4cyclictest0-21swapper/119:50:251
1818979993022,4cyclictest0-21swapper/119:40:211
1818980992924,3cyclictest0-21swapper/200:30:112
1818980992923,4cyclictest0-21swapper/219:20:162
1818980992923,3cyclictest0-21swapper/200:15:502
1818980992922,4cyclictest0-21swapper/220:50:172
1818980992921,4cyclictest0-21swapper/223:55:232
1818980992921,4cyclictest0-21swapper/221:55:342
1818980992921,4cyclictest0-21swapper/221:55:342
1818980992920,5cyclictest0-21swapper/200:35:492
1818980992919,4cyclictest0-21swapper/221:35:192
1818979992923,3cyclictest0-21swapper/120:35:251
1818979992923,3cyclictest0-21swapper/120:35:251
1818979992923,3cyclictest0-21swapper/119:30:141
1818979992922,3cyclictest0-21swapper/119:54:591
1818979992920,5cyclictest0-21swapper/120:25:211
1818980992823,3cyclictest0-21swapper/222:45:282
1818980992823,3cyclictest0-21swapper/220:05:362
1818980992822,4cyclictest0-21swapper/222:05:402
1818980992822,3cyclictest0-21swapper/219:15:592
1818980992821,4cyclictest0-21swapper/222:50:022
1818980992821,4cyclictest0-21swapper/222:10:342
1818980992821,4cyclictest0-21swapper/221:45:532
1818980992821,4cyclictest0-21swapper/221:45:532
1818980992821,4cyclictest0-21swapper/219:50:102
1818980992819,5cyclictest0-21swapper/220:30:322
1818979992822,3cyclictest0-21swapper/120:00:271
1818979992822,3cyclictest0-21swapper/119:15:101
1818980992722,3cyclictest0-21swapper/220:35:092
1818980992722,3cyclictest0-21swapper/220:35:092
1818980992720,4cyclictest0-21swapper/222:15:152
1818980992720,4cyclictest0-21swapper/220:25:372
1818980992720,4cyclictest0-21swapper/200:25:242
1818980992620,3cyclictest0-21swapper/223:24:562
1818980992619,4cyclictest0-21swapper/219:45:332
1818980992519,3cyclictest0-21swapper/221:05:082
1818980992519,3cyclictest0-21swapper/221:05:082
1818980992519,3cyclictest0-21swapper/219:30:182
1818980992418,4cyclictest0-21swapper/219:09:482
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional