You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-24 - 12:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Wed Dec 24, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
132192115104,6sleep30-21swapper/319:07:593
13160211094,11sleep10-21swapper/119:07:131
13055211098,7sleep00-21swapper/019:05:520
13305210796,6sleep20-21swapper/219:09:072
49342890,0sleep00-21swapper/023:50:120
86542800,1sleep3381ktimersoftd/321:22:333
255032690,0sleep20-21swapper/200:14:122
1340299230,21cyclictest0-21swapper/000:35:100
300012220,0sleep10-21swapper/100:19:401
245532210,1sleep26431-21nscd22:19:592
1340499211,2cyclictest0-21swapper/220:00:132
1340499211,18cyclictest0-21swapper/223:10:132
1340499211,18cyclictest0-21swapper/223:10:122
13402992116,3cyclictest26235-21ssh00:15:100
1340499200,2cyclictest0-21swapper/220:40:142
1340399200,2cyclictest0-21swapper/119:50:131
1340399200,2cyclictest0-21swapper/100:25:121
208582190,0sleep20-21swapper/219:25:272
1340599192,15cyclictest0-21swapper/321:35:043
1340399190,2cyclictest0-21swapper/122:00:121
1340599170,15cyclictest0-21swapper/322:47:043
13402991714,2cyclictest5641-21kworker/u8:122:45:050
13402991714,2cyclictest19916-21kworker/u8:122:52:050
13402991712,3cyclictest27491-21aten2.4_r3power21:45:120
13405991613,2cyclictest1036-21kworker/u8:022:31:053
13405991611,3cyclictest24919-21ssh22:20:113
1340499161,13cyclictest11180-21ssh23:56:202
1340399161,13cyclictest19555-21latency_hist20:44:591
220392150,3sleep30-21swapper/320:50:153
1340599151,2cyclictest29720-21apt-get19:50:133
13405991512,2cyclictest9079-21kworker/u8:123:46:043
13405991510,3cyclictest27202-21munin-run21:45:003
1340599150,13cyclictest0-21swapper/323:05:113
1340499153,6cyclictest0-21swapper/220:30:002
1340499152,7cyclictest20033-21ssh23:30:012
1340499151,3cyclictest25490-21touch19:40:012
13404991511,2cyclictest17683-21apt-get00:05:142
13404991510,3cyclictest13569-21sed22:05:282
13404991510,3cyclictest0-21swapper/223:27:012
1340499150,3cyclictest0-21swapper/222:22:202
1340499150,13cyclictest6675-21snmpd22:46:132
1340499150,13cyclictest0-21swapper/222:01:432
1340499150,11cyclictest0-21swapper/221:40:382
13403991511,2cyclictest0-21swapper/122:40:231
13403991510,3cyclictest31606-21cut23:05:131
1340399150,2cyclictest29479-21diskmemload21:11:591
1340399150,13cyclictest31738-21munin-node1
1340399150,13cyclictest0-21swapper/122:20:271
13402991512,2cyclictest0-21swapper/022:22:520
1340299151,12cyclictest18472-21needreboot20:40:180
1340299150,13cyclictest0-21swapper/023:49:510
95692140,2sleep029479-21diskmemload23:16:430
91382140,1sleep20-21swapper/223:15:512
238622141,3sleep323872-21ssh22:18:403
191552140,2sleep029479-21diskmemload23:28:360
1340599149,3cyclictest0-21swapper/300:25:143
13405991411,2cyclictest6002-21kworker/u8:021:54:043
13405991411,2cyclictest6002-21kworker/u8:021:29:043
13405991411,2cyclictest0-21swapper/322:01:593
13405991411,2cyclictest0-21swapper/300:23:093
13405991410,2cyclictest0-21swapper/323:55:143
1340599140,2cyclictest29479-21diskmemload23:34:193
1340599140,2cyclictest0-21swapper/323:10:153
1340599140,2cyclictest0-21swapper/323:10:143
1340599140,12cyclictest29479-21diskmemload23:50:093
1340599140,12cyclictest0-21swapper/323:41:443
1340599140,12cyclictest0-21swapper/320:30:153
1340499149,3cyclictest30777-21ssh23:41:332
1340499142,6cyclictest6352-21copy00:30:002
1340499142,6cyclictest0-21swapper/219:15:012
13404991411,2cyclictest0-21swapper/221:51:532
1340499140,2cyclictest0-21swapper/222:28:042
1340499140,2cyclictest0-21swapper/200:25:422
1340499140,12cyclictest6675-21snmpd22:36:112
1340499140,12cyclictest29479-21diskmemload23:36:262
1340499140,12cyclictest29479-21diskmemload21:30:382
1340499140,12cyclictest29479-21diskmemload00:36:002
1340499140,12cyclictest0-21swapper/223:00:462
1340499140,12cyclictest0-21swapper/222:50:112
1340499140,12cyclictest0-21swapper/220:05:122
1340399141,2cyclictest9910-21iostat_ios23:55:191
13403991411,2cyclictest0-21swapper/123:41:501
1340399140,2cyclictest29479-21diskmemload22:53:301
1340399140,2cyclictest0-21swapper/123:03:501
1340399140,12cyclictest0-21swapper/123:45:311
1340399140,12cyclictest0-21swapper/121:50:171
1340399140,12cyclictest0-21swapper/121:35:161
1340399140,12cyclictest0-21swapper/121:34:071
1340399140,12cyclictest0-21swapper/100:12:151
1340299149,3cyclictest0-21swapper/022:55:410
13402991411,2cyclictest17721-21kworker/u8:200:25:050
13402991411,2cyclictest0-21swapper/023:59:020
13402991410,2cyclictest0-21swapper/020:10:220
1340299140,2cyclictest0-21swapper/022:17:420
1340299140,12cyclictest28355-21munin-run23:40:000
1340299140,12cyclictest0-21swapper/022:10:160
1340299140,12cyclictest0-21swapper/021:36:360
1340299140,12cyclictest0-21swapper/021:26:370
1340299140,12cyclictest0-21swapper/020:25:190
98032130,2sleep00-21swapper/000:33:150
312022130,2sleep00-21swapper/022:26:200
1340599138,3cyclictest18153-21fschecks_time20:40:173
1340599138,3cyclictest0-21swapper/322:05:193
1340599131,10cyclictest24140-21ssh00:11:393
13405991310,2cyclictest29479-21diskmemload00:35:013
13405991310,2cyclictest27208-21kworker/u8:221:17:053
13405991310,2cyclictest0-21swapper/300:30:443
1340599130,3cyclictest24409-21ssh23:35:083
1340599130,2cyclictest0-21swapper/300:15:093
1340599130,11cyclictest29479-21diskmemload21:58:033
1340599130,11cyclictest29479-21diskmemload21:46:513
1340599130,11cyclictest0-21swapper/323:16:313
1340599130,11cyclictest0-21swapper/322:11:523
1340599130,11cyclictest0-21swapper/320:35:263
1340599130,11cyclictest0-21swapper/300:05:223
1340499132,6cyclictest0-21swapper/223:05:012
13404991310,2cyclictest29479-21diskmemload23:48:402
13404991310,2cyclictest29479-21diskmemload21:11:122
13404991310,2cyclictest29479-21diskmemload00:00:242
13404991310,2cyclictest0-21swapper/223:20:042
13404991310,2cyclictest0-21swapper/222:31:272
13404991310,2cyclictest0-21swapper/222:10:262
13404991310,2cyclictest0-21swapper/221:45:062
13404991310,2cyclictest0-21swapper/221:24:212
13404991310,2cyclictest0-21swapper/200:20:432
1340499130,3cyclictest27468-21sh21:05:002
1340499130,2cyclictest0-21swapper/223:50:142
1340499130,2cyclictest0-21swapper/221:17:472
1340499130,12cyclictest0-21swapper/221:55:162
1340499130,12cyclictest0-21swapper/221:35:532
1340499130,11cyclictest29479-21diskmemload21:27:462
1340399139,2cyclictest5243-21ssh22:35:121
13403991310,2cyclictest0-21swapper/123:27:051
13403991310,2cyclictest0-21swapper/123:22:071
13403991310,2cyclictest0-21swapper/122:55:071
13403991310,2cyclictest0-21swapper/121:45:071
13403991310,2cyclictest0-21swapper/121:43:281
13403991310,2cyclictest0-21swapper/121:05:141
13403991310,2cyclictest0-21swapper/100:36:451
1340399130,2cyclictest29479-21diskmemload23:50:071
1340399130,2cyclictest29479-21diskmemload22:49:481
1340399130,2cyclictest0-21swapper/123:19:011
1340399130,2cyclictest0-21swapper/122:30:041
1340399130,2cyclictest0-21swapper/122:25:301
1340399130,2cyclictest0-21swapper/121:29:501
1340399130,2cyclictest0-21swapper/121:17:021
1340399130,2cyclictest0-21swapper/100:30:051
1340399130,12cyclictest0-21swapper/123:10:041
1340399130,12cyclictest0-21swapper/123:10:041
1340399130,12cyclictest0-21swapper/122:10:191
1340399130,12cyclictest0-21swapper/121:56:351
1340399130,12cyclictest0-21swapper/100:06:161
1340399130,11cyclictest0-21swapper/120:55:191
1340399130,11cyclictest0-21swapper/119:25:211
1340299138,3cyclictest0-21swapper/022:04:340
13402991310,2cyclictest0-21swapper/023:40:130
13402991310,2cyclictest0-21swapper/023:00:540
13402991310,2cyclictest0-21swapper/022:35:160
13402991310,2cyclictest0-21swapper/022:31:010
13402991310,2cyclictest0-21swapper/022:05:510
13402991310,2cyclictest0-21swapper/021:52:130
13402991310,2cyclictest0-21swapper/020:45:230
13402991310,2cyclictest0-21swapper/019:35:150
1340299130,2cyclictest0-21swapper/023:22:150
1340299130,2cyclictest0-21swapper/021:40:020
1340299130,2cyclictest0-21swapper/021:22:400
1340299130,2cyclictest0-21swapper/020:00:180
1340299130,2cyclictest0-21swapper/019:45:190
1340299130,2cyclictest0-21swapper/000:23:100
1340299130,2cyclictest0-21swapper/000:12:480
1340299130,12cyclictest0-21swapper/023:13:560
1340299130,12cyclictest0-21swapper/023:13:560
1340299130,12cyclictest0-21swapper/023:05:110
1340299130,12cyclictest0-21swapper/021:55:120
1340299130,12cyclictest0-21swapper/021:19:220
1340299130,12cyclictest0-21swapper/021:13:410
1340299130,12cyclictest0-21swapper/000:06:050
1340299130,11cyclictest0-21swapper/023:30:110
133262130,2sleep00-21swapper/022:44:240
1340599129,2cyclictest24354-21kworker/u8:023:01:043
1340599129,2cyclictest0-21swapper/323:25:203
1340599129,2cyclictest0-21swapper/322:27:003
1340599129,2cyclictest0-21swapper/321:05:263
1340599129,2cyclictest0-21swapper/320:10:163
1340599120,11cyclictest0-21swapper/322:55:193
1340599120,11cyclictest0-21swapper/322:42:423
1340599120,11cyclictest0-21swapper/322:35:183
1340599120,11cyclictest0-21swapper/321:30:153
1340599120,11cyclictest0-21swapper/321:11:103
1340599120,11cyclictest0-21swapper/320:20:153
1340599120,11cyclictest0-21swapper/319:10:153
1340599120,10cyclictest0-21swapper/300:03:163
1340499129,2cyclictest0-21swapper/219:50:152
1340499122,7cyclictest0-21swapper/219:41:592
1340499120,2cyclictest0-21swapper/222:40:592
1340499120,2cyclictest0-21swapper/221:05:252
1340499120,2cyclictest0-21swapper/220:50:242
1340499120,2cyclictest0-21swapper/220:15:192
1340499120,11cyclictest0-21swapper/222:56:092
1340499120,11cyclictest0-21swapper/220:20:152
1340499120,11cyclictest0-21swapper/220:10:222
1340499120,11cyclictest0-21swapper/219:15:152
1340499120,11cyclictest0-21swapper/200:18:392
1340399129,2cyclictest0-21swapper/123:30:551
1340399129,2cyclictest0-21swapper/122:08:161
1340399129,2cyclictest0-21swapper/119:20:231
1340399129,2cyclictest0-21swapper/119:15:121
1340399120,2cyclictest26143-21ssh23:35:441
1340399120,2cyclictest0-21swapper/121:00:211
1340399120,2cyclictest0-21swapper/120:35:231
1340399120,2cyclictest0-21swapper/119:45:001
1340399120,2cyclictest0-21swapper/119:30:121
1340399120,11cyclictest0-21swapper/122:16:141
1340399120,11cyclictest0-21swapper/121:22:061
1340399120,11cyclictest0-21swapper/119:35:151
1340399120,11cyclictest0-21swapper/100:02:011
1340299129,2cyclictest0-21swapper/019:50:170
1340299129,2cyclictest0-21swapper/019:40:170
1340299120,2cyclictest0-21swapper/020:30:180
1340299120,2cyclictest0-21swapper/000:01:370
1340299120,11cyclictest0-21swapper/021:30:450
1340299120,11cyclictest0-21swapper/021:00:220
1340299120,11cyclictest0-21swapper/020:50:200
1340299120,11cyclictest0-21swapper/020:35:210
1340299120,11cyclictest0-21swapper/019:10:140
1340599118,2cyclictest3374-21kworker/u8:220:09:053
1340599118,2cyclictest17380-21kworker/u8:120:19:053
1340599118,2cyclictest0-21swapper/321:00:193
1340599118,2cyclictest0-21swapper/319:30:133
1340599117,2cyclictest133322sleep323:20:413
1340599111,8cyclictest20088-21ssh22:51:033
1340499116,3cyclictest12427-21needreboot20:25:182
1340499112,7cyclictest0-21swapper/219:49:022
1340499112,6cyclictest0-21swapper/220:46:592
1340399118,2cyclictest0-21swapper/120:05:161
1340399110,9cyclictest0-21swapper/120:20:141
1340399110,9cyclictest0-21swapper/120:10:171
1340299118,2cyclictest0-21swapper/020:20:180
1340299118,2cyclictest0-21swapper/019:30:250
1340299110,10cyclictest0-21swapper/019:20:010
1340599107,2cyclictest9669-21kworker/u8:220:45:053
1340599107,2cyclictest17380-21kworker/u8:120:02:043
1340599100,9cyclictest17380-21kworker/u8:119:43:053
1340499105,3cyclictest32754-21pzem19:55:222
1340499105,3cyclictest23783-21basename20:55:102
1340499102,7cyclictest0-21swapper/220:35:022
1340499100,7cyclictest0-21swapper/219:24:022
1340399103,5cyclictest0-21swapper/119:57:591
1340399100,8cyclictest11638-21aten2.4_r3power20:25:131
1340399100,8cyclictest0-21swapper/120:45:111
1340399100,8cyclictest0-21swapper/120:30:131
1340399100,2cyclictest0-21swapper/120:15:121
1340299102,6cyclictest0-21swapper/020:55:220
1340299102,5cyclictest0-21swapper/020:15:430
1340299100,6cyclictest0-21swapper/019:55:240
25210290,2sleep30-21swapper/320:57:093
134059996,2cyclictest9669-21kworker/u8:220:27:043
134059994,3cyclictest32667-21proc_pri19:55:193
134059994,3cyclictest19789-21aten2.4_r3power19:25:153
134059994,3cyclictest17929-21tr19:20:123
134059994,3cyclictest0-21swapper/319:45:193
134049994,3cyclictest22412-21wc19:30:172
134039990,8cyclictest17380-21kworker/u8:119:41:051
134039990,8cyclictest0-21swapper/120:00:131
134039990,4cyclictest0-21swapper/120:55:001
134029996,2cyclictest0-21swapper/019:25:250
134029994,3cyclictest29055-21unixbench_singl21:05:250
134029991,6cyclictest0-21swapper/020:05:220
134029991,6cyclictest0-21swapper/019:15:320
134059983,3cyclictest23708-21aten2.4-expect19:35:113
134059983,3cyclictest15654-21aten2.4_r3power19:15:133
134039985,2cyclictest0-21swapper/119:10:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional