You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-07 - 05:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Tue Apr 07, 2026 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32720211995,19sleep00-21swapper/019:08:150
742021110,0sleep10-21swapper/120:50:111
375210999,6sleep10-21swapper/119:09:531
32696210595,6sleep30-21swapper/319:07:583
32586210584,16sleep20-21swapper/219:06:332
19292850,0sleep00-21swapper/022:04:320
146852700,2sleep123-21ksoftirqd/122:16:371
280212490,1sleep128020-21ssh21:23:461
280212490,1sleep128020-21ssh21:23:451
262862240,0sleep00-21swapper/023:36:000
170032220,0sleep00-21swapper/000:34:070
412992117,2cyclictest0-21swapper/022:45:120
41499190,18cyclictest0-21swapper/221:20:142
41499190,18cyclictest0-21swapper/221:20:132
92202180,0sleep30-21swapper/321:37:513
416991815,2cyclictest14578-21kworker/u8:020:00:053
41299182,14cyclictest32587-21switchtime00:16:010
41699172,14cyclictest0-21swapper/322:03:053
41699161,13cyclictest6900-21apt-get23:50:113
41699161,13cyclictest16258-21ssh22:51:553
41699161,13cyclictest0-21swapper/300:00:153
412991611,3cyclictest25941-21perl21:55:150
41299160,3cyclictest9256-21df_abs20:55:130
41699151,3cyclictest6312-21ssh00:22:263
41699151,3cyclictest0-21swapper/320:20:153
416991512,2cyclictest26780-21kworker/u8:121:23:053
416991512,2cyclictest26780-21kworker/u8:121:23:043
416991512,2cyclictest24680-21kworker/u8:323:47:053
416991512,2cyclictest24680-21kworker/u8:323:43:053
416991512,2cyclictest24264-21kworker/u8:122:31:033
416991512,2cyclictest13707-21kworker/u8:223:24:053
41699151,12cyclictest25785-21apt-get00:10:043
41699150,14cyclictest0-21swapper/322:18:543
41699150,13cyclictest0-21swapper/322:23:333
41699150,13cyclictest0-21swapper/300:40:003
41499150,13cyclictest0-21swapper/222:53:372
413991512,2cyclictest31506-21kworker/u8:122:03:041
41399150,13cyclictest0-21swapper/123:26:351
41299151,12cyclictest21460-21runrttasks22:24:390
412991510,3cyclictest3351-21uname22:05:180
412991510,3cyclictest26198-21aten2.4_r3power00:10:130
416991411,2cyclictest31438-21kworker/u8:123:12:013
416991411,2cyclictest19606-21kworker/u8:221:29:053
416991411,2cyclictest0-21swapper/322:28:143
416991411,2cyclictest0-21swapper/322:05:143
416991411,2cyclictest0-21swapper/321:50:143
416991411,2cyclictest0-21swapper/321:34:133
41699140,13cyclictest0-21swapper/323:56:543
41699140,13cyclictest0-21swapper/322:42:243
414991410,2cyclictest2237-21apt-get22:05:072
41499140,12cyclictest715-21ssh23:10:112
41499140,12cyclictest0-21swapper/223:49:472
413991411,2cyclictest20651-21kworker/u8:222:12:041
413991411,2cyclictest0-21swapper/123:01:381
413991411,2cyclictest0-21swapper/122:20:191
41399140,13cyclictest0-21swapper/123:11:391
41399140,13cyclictest0-21swapper/120:45:191
41399140,12cyclictest0-21swapper/122:07:511
41299149,3cyclictest6069-21ssh21:35:070
41299149,3cyclictest1535-21ssh22:36:430
41299149,3cyclictest0-21swapper/021:50:170
41299149,3cyclictest0-21swapper/000:23:430
41299142,7cyclictest0-21swapper/020:45:000
412991411,2cyclictest0-21swapper/022:54:520
412991411,2cyclictest0-21swapper/022:43:030
41299140,2cyclictest0-21swapper/022:19:530
41299140,2cyclictest0-21swapper/021:30:030
41299140,2cyclictest0-21swapper/021:18:420
41299140,13cyclictest0-21swapper/019:55:130
41299140,12cyclictest14857-21aten2.4_r3power21:10:120
41299140,12cyclictest0-21swapper/023:41:240
321012140,2sleep00-21swapper/023:09:080
59902131,8sleep36144-21cat20:45:173
41699131,11cyclictest0-21swapper/323:31:353
416991310,2cyclictest7005-21kworker/u8:000:32:053
416991310,2cyclictest18599-21kworker/u8:123:00:043
416991310,2cyclictest0-21swapper/321:12:533
416991310,2cyclictest0-21swapper/320:10:153
416991310,2cyclictest0-21swapper/319:30:113
41699130,2cyclictest0-21swapper/322:55:183
41699130,2cyclictest0-21swapper/321:55:153
41699130,12cyclictest0-21swapper/321:16:043
41499138,3cyclictest20508-21vmstat22:56:032
41499138,3cyclictest20348-21sh00:36:512
41499133,6cyclictest0-21swapper/200:01:002
414991310,2cyclictest14370-21diskmemload00:06:592
414991310,2cyclictest0-21swapper/223:56:112
414991310,2cyclictest0-21swapper/223:50:402
414991310,2cyclictest0-21swapper/221:44:562
414991310,2cyclictest0-21swapper/200:24:552
41499130,2cyclictest14370-21diskmemload22:38:502
41499130,2cyclictest0-21swapper/222:15:112
41499130,2cyclictest0-21swapper/200:25:362
41499130,2cyclictest0-21swapper/200:15:012
41499130,12cyclictest0-21swapper/223:08:402
41499130,12cyclictest0-21swapper/222:41:472
41499130,12cyclictest0-21swapper/222:28:572
41499130,12cyclictest0-21swapper/219:15:172
41499130,12cyclictest0-21swapper/200:11:472
41499130,11cyclictest0-21swapper/222:30:192
41399133,9cyclictest24874-21runrttasks23:35:131
413991310,2cyclictest0-21swapper/123:50:081
413991310,2cyclictest0-21swapper/123:41:041
413991310,2cyclictest0-21swapper/122:55:291
413991310,2cyclictest0-21swapper/122:35:561
413991310,2cyclictest0-21swapper/122:25:481
413991310,2cyclictest0-21swapper/121:55:021
413991310,2cyclictest0-21swapper/121:15:021
413991310,2cyclictest0-21swapper/120:25:151
413991310,2cyclictest0-21swapper/120:20:181
413991310,2cyclictest0-21swapper/100:27:001
41399130,2cyclictest3241-21perl19:15:141
41399130,2cyclictest0-21swapper/123:45:111
41399130,2cyclictest0-21swapper/121:51:191
41399130,2cyclictest0-21swapper/121:25:411
41399130,2cyclictest0-21swapper/100:35:121
41399130,12cyclictest0-21swapper/123:55:081
41399130,12cyclictest0-21swapper/122:45:151
41399130,12cyclictest0-21swapper/121:37:301
41399130,12cyclictest0-21swapper/121:10:151
41399130,12cyclictest0-21swapper/100:18:161
41399130,11cyclictest0-21swapper/123:33:291
41399130,11cyclictest0-21swapper/120:55:391
41299131,7cyclictest0-21swapper/020:25:000
41299131,11cyclictest0-21swapper/023:33:470
412991310,2cyclictest19284-21ssh00:35:490
412991310,2cyclictest0-21swapper/023:54:590
412991310,2cyclictest0-21swapper/023:46:230
412991310,2cyclictest0-21swapper/023:21:360
412991310,2cyclictest0-21swapper/023:13:330
412991310,2cyclictest0-21swapper/022:56:330
412991310,2cyclictest0-21swapper/022:11:020
41299130,3cyclictest14370-21diskmemload00:01:130
41299130,2cyclictest0-21swapper/023:28:220
41299130,2cyclictest0-21swapper/023:03:220
41299130,2cyclictest0-21swapper/022:26:100
41299130,11cyclictest0-21swapper/021:20:140
41299130,11cyclictest0-21swapper/021:20:140
233892130,2sleep00-21swapper/000:06:140
141462130,2sleep00-21swapper/023:56:500
61472120,2sleep00-21swapper/020:45:190
41699129,2cyclictest8929-21kworker/u8:021:02:043
41699129,2cyclictest30910-21kworker/u8:300:16:043
41699129,2cyclictest26254-21kworker/u8:023:05:053
41699129,2cyclictest26014-21kworker/u8:220:25:053
41699129,2cyclictest14578-21kworker/u8:019:51:053
41699129,2cyclictest0-21swapper/323:25:103
41699129,2cyclictest0-21swapper/322:35:043
41699129,2cyclictest0-21swapper/321:45:123
41699129,2cyclictest0-21swapper/321:41:453
41699129,2cyclictest0-21swapper/300:07:463
41699120,2cyclictest0-21swapper/322:45:183
41699120,11cyclictest0-21swapper/322:12:513
41699120,11cyclictest0-21swapper/319:40:143
41699120,11cyclictest0-21swapper/300:25:283
41499129,2cyclictest14483-21ssh00:30:482
41499129,2cyclictest0-21swapper/223:41:302
41499129,2cyclictest0-21swapper/223:30:312
41499129,2cyclictest0-21swapper/222:12:312
41499129,2cyclictest0-21swapper/221:55:122
41499129,2cyclictest0-21swapper/221:11:582
41499122,6cyclictest14379-21ssh21:10:012
41499120,2cyclictest0-21swapper/222:45:092
41499120,2cyclictest0-21swapper/221:26:082
41499120,2cyclictest0-21swapper/221:16:192
41499120,2cyclictest0-21swapper/220:07:062
41499120,11cyclictest0-21swapper/223:35:412
41499120,11cyclictest0-21swapper/223:27:002
41499120,11cyclictest0-21swapper/223:20:372
41499120,11cyclictest0-21swapper/223:16:012
41499120,11cyclictest0-21swapper/223:00:302
41499120,11cyclictest0-21swapper/221:50:422
41499120,11cyclictest0-21swapper/221:36:392
41499120,11cyclictest0-21swapper/221:30:102
41499120,10cyclictest0-21swapper/222:00:262
41499120,10cyclictest0-21swapper/221:45:142
41399129,2cyclictest14370-21diskmemload00:02:521
41399129,2cyclictest0-21swapper/123:17:581
41399129,2cyclictest0-21swapper/122:52:491
41399129,2cyclictest0-21swapper/121:05:151
41399129,2cyclictest0-21swapper/119:46:001
41399120,2cyclictest14370-21diskmemload22:40:151
41399120,2cyclictest0-21swapper/120:35:171
41399120,11cyclictest0-21swapper/123:06:391
41399120,11cyclictest0-21swapper/122:30:101
41399120,11cyclictest0-21swapper/121:42:271
41399120,11cyclictest0-21swapper/121:30:391
41399120,11cyclictest0-21swapper/121:00:201
41399120,11cyclictest0-21swapper/120:40:181
41399120,11cyclictest0-21swapper/100:30:061
41399120,11cyclictest0-21swapper/100:20:011
41399120,11cyclictest0-21swapper/100:11:521
41399120,11cyclictest0-21swapper/100:05:191
41399120,10cyclictest0-21swapper/123:20:281
41399120,10cyclictest0-21swapper/121:45:161
41299129,2cyclictest0-21swapper/022:31:560
41299129,2cyclictest0-21swapper/021:00:320
41299129,2cyclictest0-21swapper/020:50:000
41299127,3cyclictest12315-21munin-run19:39:590
41299122,7cyclictest0-21swapper/019:47:020
41299122,6cyclictest0-21swapper/019:31:010
41299120,2cyclictest6605-21ssh23:15:210
41299120,11cyclictest0-21swapper/021:48:110
41299120,11cyclictest0-21swapper/021:40:050
41299120,11cyclictest0-21swapper/021:27:030
41299120,11cyclictest0-21swapper/020:30:180
41299120,11cyclictest0-21swapper/019:26:020
41299120,11cyclictest0-21swapper/019:15:140
250102120,2sleep10-21swapper/120:11:011
41699118,2cyclictest8929-21kworker/u8:021:09:053
41699118,2cyclictest8929-21kworker/u8:020:59:053
41699118,2cyclictest27105-21kworker/u8:120:05:053
41699118,2cyclictest26014-21kworker/u8:220:35:043
41699118,2cyclictest26014-21kworker/u8:220:16:053
41699118,2cyclictest10485-21kworker/u8:019:12:023
41699118,2cyclictest0-21swapper/323:37:233
41699110,10cyclictest0-21swapper/323:17:393
41699110,10cyclictest0-21swapper/320:30:133
41499118,2cyclictest0-21swapper/220:15:162
41499113,5cyclictest0-21swapper/219:46:002
41499112,6cyclictest1205-21aten2.4_r3power20:35:112
41499112,6cyclictest0-21swapper/220:33:022
41499112,6cyclictest0-21swapper/219:53:022
41499112,6cyclictest0-21swapper/219:40:022
41499111,9cyclictest3127-21nscd20:00:152
41499111,5cyclictest0-21swapper/220:30:002
41499110,2cyclictest0-21swapper/222:20:072
41499110,2cyclictest0-21swapper/220:57:172
41399118,2cyclictest0-21swapper/119:10:481
41399110,9cyclictest4879-21apt-get19:20:111
41399110,10cyclictest0-21swapper/120:30:181
41299118,2cyclictest0-21swapper/020:15:130
41299118,2cyclictest0-21swapper/019:40:040
41299118,2cyclictest0-21swapper/000:28:470
41299111,7cyclictest0-21swapper/020:08:020
41299111,6cyclictest0-21swapper/020:25:090
41499100,7cyclictest0-21swapper/219:12:012
41399107,2cyclictest0-21swapper/120:05:191
41399107,2cyclictest0-21swapper/119:50:151
41399107,2cyclictest0-21swapper/119:30:191
41399100,9cyclictest6885-21munin-node1
41399100,8cyclictest0-21swapper/119:55:151
41399100,8cyclictest0-21swapper/119:35:111
41399100,2cyclictest0-21swapper/120:15:141
41399100,2cyclictest0-21swapper/120:00:111
41399100,2cyclictest0-21swapper/119:40:061
41299105,3cyclictest5436-21fschecks_time19:20:140
4288290,2sleep30-21swapper/319:16:283
4169996,2cyclictest5477-21kworker/u8:120:50:023
4169996,2cyclictest14578-21kworker/u8:019:56:043
4169996,2cyclictest0-21swapper/319:35:153
4169996,2cyclictest0-21swapper/319:25:013
4169994,3cyclictest4373-21find20:41:003
4169994,3cyclictest14951-21df19:45:123
4169990,8cyclictest0-21swapper/319:24:043
4149996,2cyclictest0-21swapper/220:50:092
4149996,2cyclictest0-21swapper/220:45:172
4149996,2cyclictest0-21swapper/219:20:162
4149994,3cyclictest25648-21wc20:14:592
4149994,3cyclictest11200-21cpuspeed_turbos21:00:132
4149991,6cyclictest0-21swapper/220:41:002
4129994,3cyclictest952-21df_abs19:10:110
4129994,3cyclictest2850-21rsyslogd19:54:120
4129994,3cyclictest20622-21chrt20:00:100
4129993,4cyclictest13653-21sshd21:05:160
4129990,6cyclictest0-21swapper/020:36:000
4149985,2cyclictest0-21swapper/219:25:102
4149983,3cyclictest9058-21cpu19:30:132
4149983,3cyclictest3182-21lldpd19:35:102
4149983,3cyclictest28136-21cut20:20:142
4149983,3cyclictest18862-21tr19:55:122
4129983,3cyclictest23947-21cut20:10:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional