You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-20 - 17:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Mon Apr 20, 2026 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32536211999,15sleep10-21swapper/107:09:091
32447211896,16sleep30-21swapper/307:08:033
32358211695,16sleep20-21swapper/207:06:532
32310210897,6sleep00-21swapper/007:06:150
86992750,1sleep20-21swapper/209:51:042
53332720,2sleep10-21swapper/112:25:121
53332720,2sleep10-21swapper/112:25:121
196422700,1sleep20-21swapper/210:20:122
3263399260,24cyclictest0-21swapper/310:00:103
3263199240,2cyclictest0-21swapper/210:30:042
3262999240,2cyclictest0-21swapper/010:30:000
32633992117,2cyclictest0-21swapper/309:50:123
3263099210,19cyclictest0-21swapper/110:30:101
3262999211,18cyclictest0-21swapper/009:05:120
32631992017,2cyclictest2873-21kworker/u8:112:35:042
32631992017,2cyclictest15023-21kworker/u8:110:15:042
3262999200,18cyclictest0-21swapper/010:50:110
32631991815,2cyclictest9061-21kworker/u8:211:18:012
32631991815,2cyclictest8491-21kworker/u8:008:55:042
32631991815,2cyclictest4923-21kworker/u8:210:01:042
32631991815,2cyclictest32665-21kworker/u8:111:49:042
32631991815,2cyclictest28404-21kworker/u8:108:28:042
32631991815,2cyclictest19379-21kworker/u8:109:18:042
32631991815,2cyclictest1333-21kworker/u8:109:46:042
32631991815,2cyclictest1333-21kworker/u8:109:40:042
32633991714,2cyclictest8295-21kworker/u8:107:52:043
32633991714,2cyclictest15748-21kworker/u8:307:49:043
32633991714,2cyclictest11433-21kworker/u8:010:20:043
3263399170,5cyclictest0-21swapper/309:16:043
32631991714,2cyclictest8491-21kworker/u8:008:49:042
32631991714,2cyclictest8295-21kworker/u8:107:59:042
32631991714,2cyclictest27629-21kworker/u8:212:29:042
32631991714,2cyclictest27629-21kworker/u8:212:29:042
32631991714,2cyclictest2734-21kworker/u8:011:00:022
32631991714,2cyclictest26702-21kworker/u8:009:32:042
32631991714,2cyclictest25550-21kworker/u8:110:35:042
32631991714,2cyclictest24711-21kworker/u8:008:09:042
32631991714,2cyclictest23530-21kworker/u8:012:14:042
32631991714,2cyclictest19506-21kworker/u8:210:29:042
32631991714,2cyclictest19379-21kworker/u8:109:13:042
32631991714,2cyclictest1899-21kworker/u8:207:20:042
32631991714,2cyclictest16424-21kworker/u8:009:09:042
32631991714,2cyclictest15023-21kworker/u8:110:09:042
32631991714,2cyclictest10582-21kworker/u8:108:54:042
32633991613,2cyclictest4923-21kworker/u8:209:42:043
32633991613,2cyclictest32324-21kworker/u8:107:16:043
3263399160,11cyclictest0-21swapper/308:27:043
32631991613,2cyclictest9741-21kworker/u8:307:34:042
32631991613,2cyclictest9061-21kworker/u8:211:25:042
32631991613,2cyclictest8295-21kworker/u8:107:35:042
32631991613,2cyclictest6278-21kworker/u8:007:28:012
32631991613,2cyclictest4290-21kworker/u8:308:44:012
32631991613,2cyclictest32665-21kworker/u8:111:21:042
32631991613,2cyclictest28404-21kworker/u8:108:17:042
32631991613,2cyclictest27629-21kworker/u8:212:05:042
32631991613,2cyclictest2734-21kworker/u8:011:05:042
32631991613,2cyclictest2734-21kworker/u8:010:59:042
32631991613,2cyclictest23530-21kworker/u8:012:19:042
32631991613,2cyclictest1899-21kworker/u8:207:14:012
32631991613,2cyclictest15748-21kworker/u8:307:48:012
32631991613,2cyclictest10582-21kworker/u8:109:00:042
32631991611,3cyclictest0-21swapper/208:00:172
3263399152,7cyclictest0-21swapper/308:50:013
32633991512,2cyclictest9061-21kworker/u8:211:19:043
32633991512,2cyclictest4290-21kworker/u8:308:52:043
32633991512,2cyclictest32665-21kworker/u8:111:30:033
32633991512,2cyclictest27629-21kworker/u8:212:08:013
32633991512,2cyclictest2734-21kworker/u8:011:04:013
32633991512,2cyclictest23530-21kworker/u8:012:15:043
32633991512,2cyclictest23530-21kworker/u8:011:56:033
32633991512,2cyclictest14407-21kworker/u8:309:28:043
32633991512,2cyclictest14407-21kworker/u8:309:08:043
32631991512,2cyclictest27629-21kworker/u8:212:21:042
32631991512,2cyclictest15023-21kworker/u8:110:12:052
3263199150,11cyclictest0-21swapper/210:47:042
3263099151,3cyclictest17844-21diskstats11:35:131
32630991512,2cyclictest0-21swapper/111:55:181
3263099151,12cyclictest10897-21apt-get08:55:111
32630991510,3cyclictest9441-21memory07:30:171
32630991510,3cyclictest2991-21turbostat09:40:001
32630991510,3cyclictest0-21swapper/109:50:171
32630991510,3cyclictest0-21swapper/108:00:151
3263099150,3cyclictest14980-21grep07:45:131
3263099150,2cyclictest0-21swapper/109:13:511
39222140,4sleep03262999cyclictest11:00:130
3263399149,3cyclictest0-21swapper/310:55:133
3263399143,7cyclictest0-21swapper/309:21:023
32633991411,2cyclictest9061-21kworker/u8:211:43:043
32633991411,2cyclictest9061-21kworker/u8:211:38:013
32633991411,2cyclictest8295-21kworker/u8:107:58:043
32633991411,2cyclictest32735-21kworker/u8:008:38:043
32633991411,2cyclictest32665-21kworker/u8:111:28:043
32633991411,2cyclictest32665-21kworker/u8:111:22:013
32633991411,2cyclictest2873-21kworker/u8:112:32:013
32633991411,2cyclictest1899-21kworker/u8:207:27:043
32633991411,2cyclictest15023-21kworker/u8:110:08:013
32633991411,2cyclictest14407-21kworker/u8:309:02:043
32633991411,2cyclictest11433-21kworker/u8:010:45:043
3263399140,9cyclictest0-21swapper/309:30:043
3263399140,13cyclictest0-21swapper/308:00:183
3263399140,12cyclictest37-21rcuc/312:40:003
3263199149,3cyclictest11206-21tr10:00:002
32631991411,2cyclictest9061-21kworker/u8:211:39:042
32631991411,2cyclictest32324-21kworker/u8:107:17:042
32631991411,2cyclictest2873-21kworker/u8:112:32:042
32631991411,2cyclictest26702-21kworker/u8:009:23:042
32631991411,2cyclictest23530-21kworker/u8:011:54:012
32631991411,2cyclictest2298-21kworker/u8:208:35:042
32631991411,2cyclictest11433-21kworker/u8:010:42:032
3263399138,3cyclictest27032-21munin-node3
3263399131,6cyclictest0-21swapper/310:00:003
32633991310,2cyclictest8295-21kworker/u8:108:08:043
32633991310,2cyclictest4923-21kworker/u8:209:45:043
32633991310,2cyclictest4290-21kworker/u8:308:43:043
32633991310,2cyclictest32735-21kworker/u8:008:32:013
32633991310,2cyclictest32735-21kworker/u8:008:32:013
32633991310,2cyclictest32665-21kworker/u8:111:07:043
32633991310,2cyclictest32324-21kworker/u8:107:10:043
32633991310,2cyclictest25550-21kworker/u8:110:40:043
32633991310,2cyclictest24174-21munin-node3
32633991310,2cyclictest22669-21kworker/u8:208:12:043
32633991310,2cyclictest19506-21kworker/u8:210:27:043
32633991310,2cyclictest1899-21kworker/u8:207:22:013
32633991310,2cyclictest0-21swapper/311:10:173
32633991310,2cyclictest0-21swapper/307:30:163
3263399130,12cyclictest0-21swapper/312:00:143
3263399130,12cyclictest0-21swapper/310:11:023
3263199132,6cyclictest0-21swapper/211:15:002
32631991310,2cyclictest26702-21kworker/u8:009:35:042
3263099139,3cyclictest954-21latency_hist09:35:011
3263099138,3cyclictest0-21swapper/108:21:011
32630991310,2cyclictest16723-21diskmemload09:17:131
32630991310,2cyclictest0-21swapper/110:15:031
32630991310,2cyclictest0-21swapper/109:00:161
32630991310,2cyclictest0-21swapper/108:15:011
3263099130,2cyclictest0-21swapper/112:10:171
3263099130,12cyclictest0-21swapper/112:15:171
3263099130,11cyclictest3182-21lldpd09:25:121
3263099130,11cyclictest0-21swapper/107:10:301
3262999136,6cyclictest0-21swapper/011:41:010
32629991310,2cyclictest0-21swapper/009:12:190
3263399129,2cyclictest27629-21kworker/u8:212:23:043
3263399129,2cyclictest22669-21kworker/u8:208:21:043
3263399129,2cyclictest16424-21kworker/u8:009:10:043
3263399129,2cyclictest11433-21kworker/u8:010:19:043
3263399122,7cyclictest0-21swapper/311:50:023
3263399120,2cyclictest0-21swapper/310:50:163
3263399120,2cyclictest0-21swapper/309:35:173
3263399120,11cyclictest0-21swapper/312:25:133
3263399120,11cyclictest0-21swapper/312:25:133
3263199129,2cyclictest0-21swapper/211:45:002
3263199120,11cyclictest0-21swapper/212:00:142
3263099129,2cyclictest0-21swapper/110:55:131
3263099129,2cyclictest0-21swapper/110:46:021
3263099129,2cyclictest0-21swapper/109:05:171
3263099129,2cyclictest0-21swapper/108:50:171
3263099128,2cyclictest0-21swapper/111:20:181
3263099121,9cyclictest6627-21apt-get08:45:061
3263099121,9cyclictest0-21swapper/111:00:131
3263099121,9cyclictest0-21swapper/110:35:181
3263099121,9cyclictest0-21swapper/107:35:151
3263099121,3cyclictest31598-21perl08:25:141
3263099120,3cyclictest5141-21cpuspeed_turbos08:40:141
3263099120,2cyclictest0-21swapper/112:35:021
3263099120,2cyclictest0-21swapper/111:10:171
3263099120,2cyclictest0-21swapper/109:20:021
3263099120,11cyclictest0-21swapper/112:00:131
3263099120,11cyclictest0-21swapper/110:50:291
3263099120,11cyclictest0-21swapper/110:40:511
3263099120,11cyclictest0-21swapper/109:40:171
3263099120,11cyclictest0-21swapper/108:05:151
3263099120,11cyclictest0-21swapper/107:15:141
3262999127,3cyclictest31398-21munin-run10:50:000
3262999123,5cyclictest0-21swapper/009:51:020
3262999123,5cyclictest0-21swapper/007:41:020
3262999122,8cyclictest226182chrt08:03:160
3262999122,5cyclictest0-21swapper/008:55:010
3262999120,5cyclictest0-21swapper/008:45:120
3262999120,2cyclictest0-21swapper/007:20:180
3262999120,11cyclictest0-21swapper/009:20:190
3262999120,11cyclictest0-21swapper/009:16:000
3263399118,2cyclictest8295-21kworker/u8:107:38:053
3263399118,2cyclictest27629-21kworker/u8:212:11:043
3263199118,2cyclictest0-21swapper/210:50:132
3263199110,8cyclictest0-21swapper/208:23:592
3263199110,10cyclictest0-21swapper/211:56:022
3263099118,2cyclictest0-21swapper/111:30:011
3263099117,2cyclictest0-21swapper/112:05:171
3263099117,2cyclictest0-21swapper/109:45:141
3263099111,8cyclictest4589-21apt-get07:20:111
3263099111,8cyclictest0-21swapper/111:40:181
3263099111,3cyclictest9117-21munin-run12:35:001
3263099111,2cyclictest18764-21apt-get07:55:111
3263099111,2cyclictest0-21swapper/107:50:121
3263099111,2cyclictest0-21swapper/107:25:171
3263099110,9cyclictest0-21swapper/110:21:011
3263099110,9cyclictest0-21swapper/108:10:171
3263099110,3cyclictest0-21swapper/111:25:151
3263099110,3cyclictest0-21swapper/110:00:151
3263099110,10cyclictest0-21swapper/110:25:181
3263099110,10cyclictest0-21swapper/110:05:521
3262999118,2cyclictest0-21swapper/012:20:380
3262999118,2cyclictest0-21swapper/009:25:190
3262999117,2cyclictest0-21swapper/008:05:070
3262999112,6cyclictest0-21swapper/007:58:100
3262999112,5cyclictest0-21swapper/011:39:480
3262999111,6cyclictest0-21swapper/008:23:370
3262999111,5cyclictest0-21swapper/012:25:010
3262999111,5cyclictest0-21swapper/012:25:010
3262999111,5cyclictest0-21swapper/012:00:000
3262999111,5cyclictest0-21swapper/010:10:000
3262999111,2cyclictest25574-21apt-get10:35:130
3262999110,3cyclictest2639-21awk10:56:030
3262999110,1cyclictest0-21swapper/011:50:180
3262999110,1cyclictest0-21swapper/007:16:090
3263399105,3cyclictest21621-21aten2.4_r3power11:45:133
3263399105,3cyclictest11422-21fschecks_time08:55:143
3263199106,2cyclictest0-21swapper/209:25:182
3263199100,7cyclictest0-21swapper/211:32:592
3263099107,2cyclictest0-21swapper/112:20:121
3263099107,2cyclictest0-21swapper/108:35:211
3263099100,8cyclictest23492-21munin-node1
3263099100,8cyclictest0-21swapper/108:30:111
3263099100,8cyclictest0-21swapper/108:30:111
3263099100,5cyclictest0-21swapper/111:10:001
3263099100,3cyclictest0-21swapper/111:46:021
3263099100,3cyclictest0-21swapper/110:10:161
3263099100,2cyclictest0-21swapper/111:15:121
3262999107,2cyclictest0-21swapper/010:20:190
3262999105,3cyclictest20330-1kworker/0:2H10:45:000
3262999105,3cyclictest1989-21ntpq12:15:180
3262999105,3cyclictest1785-21grep09:35:170
3262999104,4cyclictest6798-21sed09:46:050
3262999102,6cyclictest0-21swapper/011:14:430
3262999102,6cyclictest0-21swapper/009:03:480
3262999101,7cyclictest17237-21munin-run11:35:000
3262999101,6cyclictest0-21swapper/008:41:010
3262999101,5cyclictest10476-21apt-get07:35:000
3262999100,8cyclictest16224-21seq07:46:050
3262999100,2cyclictest0-21swapper/012:00:000
8778290,1sleep00-21swapper/012:31:050
32656290,1sleep00-21swapper/008:27:210
326339994,3cyclictest26302-21sed10:35:193
326339990,6cyclictest0-21swapper/307:43:023
326319994,3cyclictest3728-21runrttasks08:14:582
326319994,3cyclictest16853-21aten2.4_r3power07:50:122
326319991,5cyclictest0-21swapper/208:30:192
326319991,5cyclictest0-21swapper/208:30:192
326319990,2cyclictest0-21swapper/207:41:042
326309996,2cyclictest12741-21apt-get07:40:131
326309996,2cyclictest0-21swapper/109:56:031
326299996,2cyclictest0-21swapper/010:11:390
326299994,3cyclictest8030-21unixbench_singl07:26:030
326299994,3cyclictest31704-21telnet12:10:130
326299994,3cyclictest28202-21swap08:16:030
326299994,3cyclictest26782-21chrt08:14:420
326299994,3cyclictest21839-21df10:25:140
326299994,3cyclictest12205-21cut11:20:170
326299994,3cyclictest11492-21missed_timers07:35:170
326299994,3cyclictest0-21swapper/009:45:000
326299994,3cyclictest0-21swapper/009:35:010
326299992,6cyclictest0-21swapper/008:36:030
326299992,6cyclictest0-21swapper/008:31:010
326299992,6cyclictest0-21swapper/008:31:010
326299992,5cyclictest0-21swapper/011:26:000
326299992,5cyclictest0-21swapper/007:53:090
30693290,1sleep00-21swapper/012:06:010
326299984,2cyclictest5606-21cpuspeed_turbos11:05:130
326299984,2cyclictest11500-21aten2.4_r3power10:00:110
326299983,3cyclictest9333-21sh12:35:050
326299983,3cyclictest21615-21aten2.4-expect11:45:130
326299983,3cyclictest17530-21cut10:15:120
326299983,3cyclictest1331-21wc07:10:180
326299983,3cyclictest10929-21telnet08:55:120
326299981,6cyclictest9402-21apt-get11:15:120
326299981,5cyclictest0-21swapper/009:55:000
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional