You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-30 - 20:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Tue Dec 30, 2025 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
15407211994,18sleep30-21swapper/307:05:273
15766211896,17sleep10-21swapper/107:07:001
158302113102,6sleep20-21swapper/207:07:492
15811210897,6sleep00-21swapper/007:07:350
1541621060,1sleep315415-21ssh09:26:493
149312820,1sleep0101ktimersoftd/012:34:250
25612740,1sleep10-21swapper/109:12:011
245052740,1sleep224516-21cpuspeed_turbos11:30:142
307032730,0sleep30-21swapper/312:15:123
260682700,0sleep20-21swapper/210:54:592
198642700,0sleep10-21swapper/110:10:081
96862570,4sleep21602999cyclictest10:35:142
1602899270,18cyclictest0-21swapper/112:25:121
246812210,5sleep31603099cyclictest10:52:233
1603099211,4cyclictest16026-21cyclictest11:58:053
1602999210,19cyclictest0-21swapper/208:00:122
1602999200,2cyclictest0-21swapper/207:35:002
1602799200,2cyclictest0-21swapper/007:40:120
1602799200,2cyclictest0-21swapper/007:35:000
16030991916,2cyclictest30448-21kworker/u8:009:48:063
16030991916,2cyclictest24600-21kworker/u8:108:51:043
16030991916,2cyclictest22802-21kworker/u8:310:14:053
16030991916,2cyclictest12248-21kworker/u8:107:55:053
16030991916,2cyclictest12248-21kworker/u8:107:11:053
1602999193,2cyclictest0-21swapper/210:45:052
16029991916,2cyclictest1646-21kworker/u8:211:13:042
16029991916,2cyclictest16437-21kworker/u8:312:00:052
16029991916,2cyclictest11502-21kworker/u8:011:28:052
1602999191,2cyclictest0-21swapper/211:58:052
16030991815,2cyclictest5281-21kworker/u8:109:55:053
16030991815,2cyclictest30448-21kworker/u8:009:52:053
16030991815,2cyclictest27006-21kworker/u8:111:44:053
16030991815,2cyclictest2149-21kworker/u8:010:58:053
16030991815,2cyclictest2149-21kworker/u8:010:38:053
16030991815,2cyclictest16437-21kworker/u8:312:01:053
16030991815,2cyclictest15491-21kworker/u8:012:38:053
16030991815,2cyclictest12248-21kworker/u8:108:21:053
16030991815,2cyclictest11502-21kworker/u8:011:16:053
1603099181,2cyclictest18542-21ssh10:08:053
16029991815,2cyclictest4732-21kworker/u8:212:33:052
16029991815,2cyclictest2149-21kworker/u8:010:57:042
1602999180,16cyclictest0-21swapper/210:20:122
1602999180,16cyclictest0-21swapper/210:20:122
16030991714,2cyclictest9249-21kworker/u8:012:12:053
16030991714,2cyclictest28619-21kworker/u8:207:41:053
16030991714,2cyclictest22802-21kworker/u8:310:21:053
16030991714,2cyclictest22802-21kworker/u8:310:21:053
16030991714,2cyclictest2149-21kworker/u8:011:09:053
16030991714,2cyclictest21299-21kworker/u8:112:21:053
16030991714,2cyclictest20919-21kworker/u8:207:29:033
16030991714,2cyclictest19013-21kworker/u8:211:25:053
16030991714,2cyclictest16176-21kworker/u8:208:44:043
16030991714,2cyclictest14855-21kworker/u8:209:32:053
16030991714,2cyclictest12248-21kworker/u8:108:11:053
16030991714,2cyclictest12248-21kworker/u8:107:37:053
16030991714,2cyclictest12248-21kworker/u8:107:24:043
16030991714,2cyclictest11502-21kworker/u8:011:22:053
16030991714,2cyclictest11429-21kworker/u8:010:16:053
16030991714,2cyclictest11429-21kworker/u8:010:16:053
1603099170,2cyclictest0-21swapper/310:27:053
1603099170,12cyclictest0-21swapper/309:12:053
1603099170,12cyclictest0-21swapper/307:53:033
16029991714,2cyclictest22802-21kworker/u8:310:15:052
16029991714,2cyclictest22802-21kworker/u8:310:15:052
16029991714,2cyclictest16277-21kworker/u8:007:19:032
16029991714,2cyclictest12248-21kworker/u8:107:49:052
1602999170,11cyclictest0-21swapper/212:37:052
1602799171,14cyclictest0-21swapper/009:35:160
1603099162,5cyclictest0-21swapper/307:30:593
16030991613,2cyclictest9249-21kworker/u8:012:08:053
16030991613,2cyclictest308-21kworker/u8:009:24:053
16030991613,2cyclictest28045-21kworker/u8:208:56:053
16030991613,2cyclictest24600-21kworker/u8:109:04:053
16029991613,2cyclictest9249-21kworker/u8:012:19:052
1602899161,3cyclictest0-21swapper/112:20:391
16028991611,3cyclictest10696-21cpuspeed_turbos08:15:141
1602899161,13cyclictest0-21swapper/111:38:291
1602899160,14cyclictest5411-21kernelversion10:30:171
1602799162,7cyclictest0-21swapper/010:35:000
16027991612,2cyclictest32396-21diskmemload11:40:410
1602799161,13cyclictest27257-21ssh12:10:180
1602799161,13cyclictest0-21swapper/009:27:520
16027991611,3cyclictest0-21swapper/008:35:010
1602799160,14cyclictest32396-21diskmemload09:45:210
16030991512,2cyclictest32596-21kworker/u8:008:00:043
16030991512,2cyclictest16277-21kworker/u8:007:18:043
16030991512,2cyclictest12248-21kworker/u8:107:46:043
16030991512,2cyclictest12054-21kworker/u8:008:27:053
1603099150,2cyclictest32396-21diskmemload11:50:403
1603099150,2cyclictest0-21swapper/308:46:053
1603099150,13cyclictest0-21swapper/310:43:403
16029991512,2cyclictest9249-21kworker/u8:012:14:052
16029991512,2cyclictest6324-21kworker/u8:109:26:052
16029991512,2cyclictest2149-21kworker/u8:011:00:052
16029991512,2cyclictest20359-21kworker/u8:009:37:042
16029991512,2cyclictest12248-21kworker/u8:107:12:042
1602999150,2cyclictest0-21swapper/212:07:052
16028991512,2cyclictest32396-21diskmemload12:13:521
16028991512,2cyclictest0-21swapper/112:15:421
1602899150,2cyclictest0-21swapper/109:48:511
1602799151,12cyclictest32602-21apt-get07:50:110
1602799151,12cyclictest15600-21runrttasks11:56:330
1602799151,12cyclictest0-21swapper/010:50:160
1602799150,13cyclictest0-21swapper/007:45:060
16030991411,2cyclictest12248-21kworker/u8:108:05:033
1603099140,2cyclictest21652-21ssh09:35:053
1603099140,2cyclictest0-21swapper/309:44:053
1603099140,2cyclictest0-21swapper/308:15:053
1603099140,13cyclictest0-21swapper/311:33:003
1603099140,12cyclictest9445-21ssh12:27:103
1603099140,12cyclictest0-21swapper/310:30:173
1602999141,2cyclictest32485-21apt-get10:25:072
16029991411,2cyclictest9249-21kworker/u8:012:22:052
16029991411,2cyclictest6324-21kworker/u8:109:42:052
16029991411,2cyclictest27006-21kworker/u8:111:48:052
16029991411,2cyclictest25212-21kworker/u8:209:46:052
16029991411,2cyclictest12248-21kworker/u8:108:07:032
16029991411,2cyclictest12248-21kworker/u8:107:30:042
16029991411,2cyclictest11429-21kworker/u8:010:06:052
16029991410,2cyclictest16875-21diskstats08:30:132
1602899149,3cyclictest178942sleep110:06:511
1602899149,3cyclictest15274-21cat08:25:171
1602899142,7cyclictest0-21swapper/110:40:011
1602899142,7cyclictest0-21swapper/110:20:001
1602899142,7cyclictest0-21swapper/110:20:001
1602899142,6cyclictest0-21swapper/109:05:001
16028991411,2cyclictest0-21swapper/111:23:481
16028991411,2cyclictest0-21swapper/111:13:151
16028991411,2cyclictest0-21swapper/109:42:211
1602899141,11cyclictest0-21swapper/110:48:321
1602899140,3cyclictest16461-21ssh11:58:091
1602899140,13cyclictest0-21swapper/109:37:221
1602899140,12cyclictest32396-21diskmemload11:50:181
1602899140,12cyclictest32396-21diskmemload10:00:541
1602899140,12cyclictest0-21swapper/112:04:261
1602899140,12cyclictest0-21swapper/111:45:241
1602899140,12cyclictest0-21swapper/110:57:431
1602899140,12cyclictest0-21swapper/110:50:061
1602899140,12cyclictest0-21swapper/109:55:071
1602899140,12cyclictest0-21swapper/109:31:451
1602899140,12cyclictest0-21swapper/109:20:171
1602799142,6cyclictest0-21swapper/012:25:000
1602799141,3cyclictest19151-21ssh11:24:080
16027991411,2cyclictest32396-21diskmemload12:21:510
16027991411,2cyclictest0-21swapper/010:56:110
16027991411,2cyclictest0-21swapper/009:58:490
1602799140,3cyclictest0-21swapper/009:30:500
1602799140,2cyclictest26569-21apt-get08:55:100
1602799140,2cyclictest0-21swapper/010:39:210
1602799140,2cyclictest0-21swapper/010:18:110
1602799140,2cyclictest0-21swapper/010:18:110
1602799140,12cyclictest2383-21ssh10:26:200
1602799140,12cyclictest0-21swapper/012:15:170
1602799140,12cyclictest0-21swapper/011:28:400
1602799140,12cyclictest0-21swapper/009:05:220
1603099131,10cyclictest32396-21diskmemload10:02:043
1603099130,2cyclictest0-21swapper/311:04:433
1603099130,12cyclictest0-21swapper/311:35:503
1603099130,12cyclictest0-21swapper/309:15:503
16029991311,1cyclictest0-21swapper/212:28:502
16029991310,2cyclictest32396-21diskmemload11:05:192
16029991310,2cyclictest27006-21kworker/u8:111:54:052
16029991310,2cyclictest2149-21kworker/u8:010:43:042
16029991310,2cyclictest16176-21kworker/u8:208:50:052
16029991310,2cyclictest16176-21kworker/u8:208:40:042
16029991310,2cyclictest16176-21kworker/u8:208:37:052
16029991310,2cyclictest12248-21kworker/u8:108:12:042
1602999130,2cyclictest0-21swapper/211:38:052
1602999130,2cyclictest0-21swapper/210:30:052
1602999130,2cyclictest0-21swapper/208:20:122
1602999130,12cyclictest0-21swapper/210:14:592
1602999130,12cyclictest0-21swapper/210:04:392
1602899132,6cyclictest0-21swapper/108:35:011
1602899131,6cyclictest0-21swapper/107:18:011
16028991310,2cyclictest32396-21diskmemload10:25:451
16028991310,2cyclictest0-21swapper/112:33:221
16028991310,2cyclictest0-21swapper/112:06:591
16028991310,2cyclictest0-21swapper/111:34:211
16028991310,2cyclictest0-21swapper/111:26:011
16028991310,2cyclictest0-21swapper/110:35:111
16028991310,2cyclictest0-21swapper/108:35:241
16028991310,2cyclictest0-21swapper/107:25:171
1602899130,2cyclictest32396-21diskmemload11:44:391
1602899130,2cyclictest32396-21diskmemload10:22:171
1602899130,2cyclictest32396-21diskmemload10:22:171
1602899130,2cyclictest0-21swapper/112:38:561
1602899130,2cyclictest0-21swapper/109:53:111
1602899130,2cyclictest0-21swapper/109:18:411
1602899130,2cyclictest0-21swapper/107:55:261
1602899130,12cyclictest0-21swapper/111:05:161
1602899130,12cyclictest0-21swapper/111:00:451
1602899130,12cyclictest0-21swapper/107:50:211
1602899130,11cyclictest32396-21diskmemload11:15:051
1602899130,11cyclictest0-21swapper/109:25:211
1602799132,6cyclictest0-21swapper/011:55:000
1602799132,6cyclictest0-21swapper/010:10:000
16027991310,2cyclictest0-21swapper/011:46:140
16027991310,2cyclictest0-21swapper/008:40:120
1602799130,2cyclictest0-21swapper/011:35:470
1602799130,2cyclictest0-21swapper/011:30:050
1602799130,2cyclictest0-21swapper/010:47:200
1602799130,2cyclictest0-21swapper/010:14:010
1602799130,2cyclictest0-21swapper/010:00:310
1602799130,2cyclictest0-21swapper/009:50:160
1602799130,12cyclictest0-21swapper/012:35:270
1602799130,12cyclictest0-21swapper/012:08:010
1602799130,12cyclictest0-21swapper/011:10:030
1602799130,12cyclictest0-21swapper/011:06:230
1602799130,12cyclictest0-21swapper/011:00:590
1602799130,12cyclictest0-21swapper/009:21:260
1602799130,11cyclictest0-21swapper/011:18:030
1602799130,11cyclictest0-21swapper/010:41:030
88332120,2sleep20-21swapper/209:20:082
1603099129,2cyclictest0-21swapper/310:47:353
1603099123,6cyclictest0-21swapper/308:37:593
1603099122,7cyclictest0-21swapper/311:47:593
1602999129,2cyclictest6948-21kworker/u8:111:17:052
1602999129,2cyclictest4285-21kworker/u8:208:17:052
1602999129,2cyclictest0-21swapper/209:55:122
1602999129,2cyclictest0-21swapper/207:40:152
1602999120,11cyclictest0-21swapper/209:50:182
1602899128,2cyclictest0-21swapper/108:00:161
1602899127,3cyclictest21073-21cut08:40:151
1602899121,3cyclictest8383-21munin-node1
1602899121,3cyclictest24562-21munin-node1
1602899121,3cyclictest0-21swapper/107:35:121
1602899120,2cyclictest0-21swapper/109:05:121
1602899120,2cyclictest0-21swapper/107:30:281
1602899120,11cyclictest30391-21copy07:45:031
1602899120,11cyclictest0-21swapper/108:05:271
1602799129,2cyclictest0-21swapper/007:55:190
1602799122,7cyclictest0-21swapper/009:02:590
1602799120,6cyclictest0-21swapper/007:20:000
1602799120,11cyclictest2235-21ssh09:11:200
1602799120,11cyclictest0-21swapper/012:00:230
1602799120,11cyclictest0-21swapper/010:20:140
1602799120,11cyclictest0-21swapper/010:20:140
1602799120,11cyclictest0-21swapper/009:41:470
1602799120,11cyclictest0-21swapper/009:15:250
1602799120,11cyclictest0-21swapper/008:45:220
1602799120,11cyclictest0-21swapper/008:15:190
1602799120,11cyclictest0-21swapper/008:00:170
1602799120,11cyclictest0-21swapper/007:25:120
143432120,2sleep30-21swapper/312:33:213
65902110,2sleep20-21swapper/209:16:352
1603099112,7cyclictest0-21swapper/309:05:593
1602999118,2cyclictest28045-21kworker/u8:209:00:052
1602999113,6cyclictest0-21swapper/211:40:242
1602999110,10cyclictest32396-21diskmemload09:33:452
1602999110,10cyclictest0-21swapper/211:20:472
1602999110,10cyclictest0-21swapper/209:10:062
1602899114,5cyclictest0-21swapper/107:40:261
1602899111,8cyclictest0-21swapper/107:20:151
1602899111,8cyclictest0-21swapper/107:10:151
1602799118,2cyclictest0-21swapper/008:05:210
1602799113,6cyclictest0-21swapper/008:50:250
1602799111,7cyclictest7497-21gdm-simple-gree08:35:590
1603099105,3cyclictest7476-21fschecks_count11:10:143
1603099105,3cyclictest17802-21grep08:30:253
1602999105,3cyclictest27380-21wc08:55:152
1602999102,6cyclictest0-21swapper/208:25:232
1602899105,3cyclictest27222-21if_eth008:55:141
1602899100,2cyclictest0-21swapper/108:45:131
1602799107,2cyclictest0-21swapper/008:20:150
1602799102,7cyclictest0-21swapper/008:12:580
1602799102,6cyclictest0-21swapper/008:28:290
160299994,3cyclictest24125-21seq08:47:192
160299994,3cyclictest2249-21aten2.4_r3power07:55:122
160299994,3cyclictest20683-21forks07:20:122
160299990,5cyclictest0-21swapper/209:10:002
160299990,2cyclictest0-21swapper/207:28:042
160289994,3cyclictest13103-21modprobe08:20:161
160279994,3cyclictest16646-21forks07:10:140
160279993,4cyclictest19384-21grep07:15:250
160279990,7cyclictest0-21swapper/007:30:290
160299985,2cyclictest0-21swapper/207:50:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional