You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-12 - 21:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Fri Jun 12, 2026 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1196221450,2sleep33014099cyclictest10:53:153
29930211397,11sleep30-21swapper/307:07:433
29901210789,13sleep10-21swapper/107:07:211
28325210477,20sleep00-21swapper/007:05:120
29914210378,6sleep20-21swapper/207:07:302
169922830,1sleep2301ktimersoftd/212:09:222
263712660,0sleep30-21swapper/309:23:363
74542510,0sleep00-21swapper/008:55:110
73022330,1sleep00-21swapper/011:58:300
240202260,0sleep10-21swapper/111:05:481
219242260,6sleep23013999cyclictest09:18:582
3013899231,12cyclictest0-21swapper/110:40:411
3013799230,17cyclictest0-21swapper/011:05:090
3013999220,20cyclictest13464-21munin-node2
3013899220,12cyclictest0-21swapper/110:04:591
30140992116,3cyclictest11254-21kworker/u8:209:43:043
3014099211,18cyclictest0-21swapper/309:30:123
3013999211,8cyclictest27148-21munin-node2
3013999211,18cyclictest0-21swapper/207:50:152
30138992110,3cyclictest3259-21chrt10:09:231
3013899210,3cyclictest0-21swapper/111:40:171
30140992016,3cyclictest1267-21kworker/u8:111:32:043
30140992016,2cyclictest8303-21kworker/u8:109:18:043
30140992016,2cyclictest0-21swapper/311:25:103
3014099201,17cyclictest0-21swapper/312:10:093
30139992016,2cyclictest0-21swapper/211:05:082
3013999200,18cyclictest0-21swapper/212:36:592
3013999200,18cyclictest0-21swapper/210:16:022
3013899203,7cyclictest8013-21copy07:35:001
3013899202,12cyclictest0-21swapper/107:17:021
3013899200,12cyclictest28253-21taskset11:45:271
3014099192,2cyclictest0-21swapper/312:34:053
3013999190,8cyclictest0-21swapper/212:25:382
3013999190,17cyclictest13378-21ssh09:10:102
3013999190,17cyclictest0-21swapper/210:43:572
3013999190,17cyclictest0-21swapper/209:53:492
30138991910,2cyclictest24532-21smartctl09:21:021
30138991910,2cyclictest13080-21diskmemload10:11:161
3013899190,11cyclictest0-21swapper/111:10:491
3013799190,2cyclictest0-21swapper/008:45:120
3013799190,17cyclictest17909-21ssh11:35:110
204402190,0sleep30-21swapper/309:51:573
30140991815,2cyclictest29221-21kworker/u8:010:20:053
3013999180,7cyclictest0-21swapper/209:25:082
3013999180,17cyclictest0-21swapper/211:37:022
3013999180,17cyclictest0-21swapper/211:10:052
3013999180,16cyclictest0-21swapper/212:16:242
3013999180,16cyclictest0-21swapper/210:32:332
3013999180,16cyclictest0-21swapper/210:21:062
3013899182,7cyclictest0-21swapper/110:55:001
228492180,0sleep00-21swapper/009:20:040
30140991714,2cyclictest29221-21kworker/u8:010:25:053
30140991714,2cyclictest24526-21kworker/u8:210:38:053
30140991714,2cyclictest21646-21kworker/u8:111:48:013
30140991714,2cyclictest12105-21kworker/u8:212:08:043
30140991714,2cyclictest11843-21kworker/u8:210:56:043
3014099170,2cyclictest0-21swapper/310:17:043
30139991711,5cyclictest0-21swapper/212:00:092
3013999170,7cyclictest0-21swapper/210:10:232
3013999170,6cyclictest0-21swapper/209:58:362
3013999170,6cyclictest0-21swapper/209:00:162
3013999170,16cyclictest0-21swapper/211:25:142
3013999170,16cyclictest0-21swapper/210:54:522
3013999170,16cyclictest0-21swapper/209:40:552
3013999170,16cyclictest0-21swapper/207:45:192
3013999170,15cyclictest13080-21diskmemload11:59:442
3013999170,15cyclictest0-21swapper/211:52:082
3013999170,15cyclictest0-21swapper/209:30:112
3013999170,15cyclictest0-21swapper/207:55:142
30137991714,2cyclictest29221-21kworker/u8:010:05:100
30140991613,2cyclictest4771-21kworker/u8:212:38:053
30140991613,2cyclictest32000-21kworker/u8:011:04:053
30140991613,2cyclictest32000-21kworker/u8:010:46:053
30140991613,2cyclictest29221-21kworker/u8:010:11:053
30140991613,2cyclictest24520-21kworker/u8:309:59:053
30140991613,2cyclictest21646-21kworker/u8:111:53:053
3013999160,6cyclictest0-21swapper/212:22:022
3013999160,5cyclictest0-21swapper/210:26:502
3013999160,15cyclictest0-21swapper/212:12:392
3013999160,15cyclictest0-21swapper/211:47:552
3013999160,15cyclictest0-21swapper/211:22:462
3013999160,15cyclictest0-21swapper/210:38:192
3013999160,15cyclictest0-21swapper/208:20:202
3013999160,15cyclictest0-21swapper/208:15:122
3013999160,14cyclictest0-21swapper/209:38:422
3013899161,13cyclictest20767-21diskstats08:05:151
3013799161,2cyclictest13080-21diskmemload11:15:050
30140991512,2cyclictest445-21kworker/u8:011:58:043
30140991512,2cyclictest32000-21kworker/u8:010:43:043
30140991512,2cyclictest31526-21kworker/u8:009:38:053
30140991512,2cyclictest27266-21kworker/u8:011:18:053
30140991512,2cyclictest22257-21kworker/u8:211:05:043
30140991512,2cyclictest16541-21kworker/u8:111:10:053
30140991512,2cyclictest12105-21kworker/u8:212:15:053
3013999152,7cyclictest0-21swapper/211:35:002
3013999150,14cyclictest0-21swapper/211:40:112
3013999150,14cyclictest0-21swapper/209:20:132
3013999150,13cyclictest0-21swapper/211:02:352
3013899155,7cyclictest3688-21Xorg11:26:591
3013899151,7cyclictest0-21swapper/109:07:581
30138991510,3cyclictest10214-21munin-node1
3013899150,13cyclictest0-21swapper/111:04:201
3013899150,13cyclictest0-21swapper/108:30:161
30137991510,3cyclictest7422-21ssh10:13:220
30137991510,3cyclictest0-21swapper/011:40:140
3013799150,2cyclictest0-21swapper/007:15:110
3014099141,2cyclictest0-21swapper/307:15:123
30140991411,2cyclictest31526-21kworker/u8:009:47:053
30140991411,2cyclictest29970-21kworker/u8:207:54:063
30140991411,2cyclictest29221-21kworker/u8:010:05:043
30140991411,2cyclictest27266-21kworker/u8:011:20:013
30140991411,2cyclictest24004-21kworker/u8:008:38:013
30140991411,2cyclictest24004-21kworker/u8:008:31:053
30140991411,2cyclictest22161-21kworker/u8:107:12:013
30140991411,2cyclictest20030-21kworker/u8:008:05:053
30140991411,2cyclictest16855-21kworker/u8:011:39:053
30140991411,2cyclictest0-21swapper/307:55:123
3014099140,9cyclictest0-21swapper/308:45:053
3014099140,12cyclictest0-21swapper/307:21:043
3013999148,5cyclictest0-21swapper/210:08:552
3013999148,5cyclictest0-21swapper/208:55:192
3013999144,8cyclictest3649-21snmpd07:10:382
3013999144,8cyclictest3554-21aten2.4-expect08:45:132
3013999144,8cyclictest13373-21aten2.4_r3power10:55:122
3013999144,8cyclictest11384-21telnet09:05:122
3013999143,9cyclictest31910-21stty11:15:112
3013999141,11cyclictest31387-21kworker/u8:112:30:152
3013999140,13cyclictest0-21swapper/210:49:082
3013999140,12cyclictest0-21swapper/208:41:032
3013899142,6cyclictest0-21swapper/107:45:001
3013899141,7cyclictest0-21swapper/110:30:011
3013899141,7cyclictest0-21swapper/108:30:001
3013899140,3cyclictest0-21swapper/110:37:431
3013899140,2cyclictest0-21swapper/109:53:001
3013899140,12cyclictest0-21swapper/112:15:131
3013899140,11cyclictest0-21swapper/109:19:521
3013799149,3cyclictest32147-21cpuspeed_turbos10:40:130
3013799140,3cyclictest26969-21stty12:20:130
3013799140,12cyclictest4400-21kworker/u8:109:41:040
3013799140,12cyclictest29650-21ssh11:47:080
3013799140,12cyclictest22429-21latency_hist10:30:010
3013799140,12cyclictest0-21swapper/012:28:180
3013799140,12cyclictest0-21swapper/010:16:100
110992140,1sleep10-21swapper/109:41:291
52282130,2sleep30-21swapper/307:26:063
30140991310,2cyclictest5585-21kworker/u8:008:52:013
30140991310,2cyclictest445-21kworker/u8:012:02:053
30140991310,2cyclictest31437-21kworker/u8:209:00:043
30140991310,2cyclictest31437-21kworker/u8:208:42:053
30140991310,2cyclictest31387-21kworker/u8:112:26:053
30140991310,2cyclictest29970-21kworker/u8:207:40:053
30140991310,2cyclictest29970-21kworker/u8:207:30:053
30140991310,2cyclictest24004-21kworker/u8:008:18:023
30140991310,2cyclictest19086-21kworker/u8:110:33:043
30140991310,2cyclictest0-21swapper/308:25:123
3014099130,2cyclictest0-21swapper/309:26:043
3014099130,12cyclictest0-21swapper/309:13:223
3014099130,11cyclictest30030-21ssh12:23:203
3013999133,8cyclictest3182-21lldpd08:32:392
3013999132,6cyclictest0-21swapper/207:29:592
3013999131,8cyclictest0-21swapper/207:35:162
3013999131,10cyclictest6629-21cut07:30:172
3013999131,10cyclictest32019-21cpuspeed_turbos08:35:122
3013999131,10cyclictest18365-21runrttasks08:00:102
3013999131,10cyclictest10365-21telnet07:40:152
3013999130,2cyclictest0-21swapper/208:11:032
3013999130,2cyclictest0-21swapper/207:15:192
3013899132,5cyclictest0-21swapper/109:30:001
3013899131,10cyclictest15338-21taskset07:50:501
30138991310,2cyclictest3728-21runrttasks12:36:451
30138991310,2cyclictest0-21swapper/112:21:331
30138991310,2cyclictest0-21swapper/110:23:461
30138991310,2cyclictest0-21swapper/109:45:461
3013899130,2cyclictest0-21swapper/111:35:321
3013899130,2cyclictest0-21swapper/110:32:231
3013899130,2cyclictest0-21swapper/109:35:101
3013899130,12cyclictest0-21swapper/111:30:121
3013899130,11cyclictest13080-21diskmemload12:30:141
3013899130,11cyclictest0-21swapper/112:06:061
3013899130,11cyclictest0-21swapper/111:21:011
3013899130,11cyclictest0-21swapper/111:16:261
3013799139,2cyclictest30433-21ssh11:13:090
30137991310,2cyclictest14926-21munin-node0
30137991310,2cyclictest0-21swapper/012:35:140
30137991310,2cyclictest0-21swapper/009:35:310
30137991310,2cyclictest0-21swapper/007:25:190
3013799130,12cyclictest0-21swapper/011:22:350
3013799130,11cyclictest13080-21diskmemload10:57:010
3013799130,11cyclictest0-21swapper/011:01:310
3014099129,2cyclictest8303-21kworker/u8:108:56:063
3014099129,2cyclictest21646-21kworker/u8:111:41:043
3014099120,7cyclictest0-21swapper/309:05:053
3014099120,2cyclictest0-21swapper/310:00:053
3014099120,2cyclictest0-21swapper/308:00:183
3014099120,11cyclictest0-21swapper/307:35:123
3013999121,9cyclictest28023-21aten2.4_r3power08:25:122
3013999121,9cyclictest20400-21cut08:05:132
3013999121,9cyclictest1955-21taskset07:20:082
3013999121,9cyclictest0-21swapper/208:50:112
3013899129,2cyclictest0-21swapper/111:50:051
3013899129,2cyclictest0-21swapper/110:45:151
3013899128,2cyclictest8252-21munin-node1
3013899121,9cyclictest10441-21python09:01:031
3013899121,9cyclictest0-21swapper/110:55:141
3013899121,9cyclictest0-21swapper/108:35:131
3013899121,9cyclictest0-21swapper/107:26:071
3013899121,3cyclictest7248-21munin-node1
3013899121,3cyclictest13400-21apt-get09:10:121
3013899121,3cyclictest0-21swapper/107:55:161
3013899120,3cyclictest0-21swapper/107:20:191
3013899120,2cyclictest0-21swapper/112:11:171
3013899120,11cyclictest0-21swapper/110:15:341
3013899120,11cyclictest0-21swapper/109:55:091
3013899120,11cyclictest0-21swapper/109:25:581
3013899120,11cyclictest0-21swapper/108:41:021
3013899120,11cyclictest0-21swapper/107:45:151
3013899120,10cyclictest0-21swapper/111:55:481
3013799129,2cyclictest0-21swapper/011:33:200
3013799129,2cyclictest0-21swapper/010:00:500
3013799129,2cyclictest0-21swapper/009:55:490
3013799129,2cyclictest0-21swapper/009:30:140
3013799122,7cyclictest0-21swapper/007:41:580
3013799121,9cyclictest24920-21iostat_ios08:15:150
3013799120,2cyclictest0-21swapper/012:31:200
3013799120,2cyclictest0-21swapper/012:18:190
3013799120,2cyclictest0-21swapper/012:10:130
3013799120,2cyclictest0-21swapper/009:25:200
3013799120,2cyclictest0-21swapper/009:00:410
3013799120,11cyclictest13080-21diskmemload12:04:180
3013799120,11cyclictest0-21swapper/012:06:110
3013799120,11cyclictest0-21swapper/011:51:280
3013799120,11cyclictest0-21swapper/011:25:380
3013799120,11cyclictest0-21swapper/010:54:240
3013799120,11cyclictest0-21swapper/010:45:120
3013799120,11cyclictest0-21swapper/010:23:150
3013799120,11cyclictest0-21swapper/009:53:210
3013799120,11cyclictest0-21swapper/007:51:040
3013799120,11cyclictest0-21swapper/007:20:140
3014099118,2cyclictest24004-21kworker/u8:008:22:023
3014099118,2cyclictest1435-21kworker/u8:007:49:043
3013899118,2cyclictest0-21swapper/112:26:191
3013899118,2cyclictest0-21swapper/108:15:141
3013899116,3cyclictest3422-21munin-node1
3013899112,6cyclictest0-21swapper/108:13:591
3013899111,6cyclictest0-21swapper/108:24:131
3013899110,9cyclictest0-21swapper/108:00:111
3013899110,9cyclictest0-21swapper/107:10:101
3013899110,3cyclictest0-21swapper/108:50:131
3013799118,2cyclictest17808-21apt-get09:15:050
3013799118,2cyclictest0-21swapper/007:10:130
3013799112,6cyclictest0-21swapper/008:32:010
3013799112,6cyclictest0-21swapper/008:28:010
3013799112,6cyclictest0-21swapper/007:46:590
3013799110,9cyclictest29970-21kworker/u8:207:56:050
3013799110,2cyclictest0-21swapper/010:38:390
3013799110,10cyclictest24004-21kworker/u8:008:36:050
3013799110,10cyclictest0-21swapper/010:32:110
3013799110,10cyclictest0-21swapper/009:45:010
3014099107,2cyclictest29970-21kworker/u8:208:13:043
3013799102,7cyclictest0-21swapper/007:37:580
3013799102,6cyclictest0-21swapper/008:41:020
3013799102,5cyclictest0-21swapper/008:54:010
3013799101,6cyclictest0-21swapper/008:09:100
3013799100,7cyclictest0-21swapper/008:02:010
301379994,3cyclictest6748-21grep07:30:170
301379994,3cyclictest11465-21cpu09:05:130
301379985,2cyclictest26805-21fschecks_time08:20:150
301379983,3cyclictest22309-21basename08:10:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional