You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-17 - 02:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Sun May 17, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
918521520,5sleep13233899cyclictest20:50:161
918521520,5sleep13233899cyclictest20:50:161
1973321430,5sleep13233899cyclictest21:13:401
32272212298,18sleep00-21swapper/019:09:310
32152212299,17sleep20-21swapper/219:07:572
32036211092,12sleep30-21swapper/319:06:303
32273210790,12sleep10-21swapper/119:09:321
311752700,0sleep10-21swapper/100:21:101
188032690,0sleep00-21swapper/021:47:180
3233899240,14cyclictest0-21swapper/119:55:181
246552230,0sleep10-21swapper/121:19:091
3233899213,16cyclictest24575-21munin-node1
3233899211,18cyclictest0-21swapper/123:25:111
32338992011,7cyclictest0-21swapper/119:35:171
3233899200,3cyclictest27179-21sed21:21:031
3233899200,13cyclictest12054-21http_loadtime22:15:151
32339991916,2cyclictest16293-21kworker/u8:221:13:042
3233899197,3cyclictest0-21swapper/123:46:021
3233899197,3cyclictest0-21swapper/123:46:021
3233899191,3cyclictest0-21swapper/120:31:061
3233899191,16cyclictest7108-21df22:45:121
3233899190,2cyclictest0-21swapper/122:55:391
3233899190,2cyclictest0-21swapper/121:55:291
3234099180,16cyclictest0-21swapper/321:55:123
32339991815,2cyclictest7980-21kworker/u8:123:40:042
32339991815,2cyclictest493-21kworker/u8:121:29:042
32339991815,2cyclictest2780-21kworker/u8:200:09:042
3233899186,2cyclictest0-21swapper/100:30:141
3233899180,3cyclictest860-21ssh21:28:151
3233899180,2cyclictest0-21swapper/122:44:131
3233899180,2cyclictest0-21swapper/100:00:511
3233899180,16cyclictest0-21swapper/122:21:021
32340991714,2cyclictest23473-21kworker/u8:222:57:043
32340991713,2cyclictest10967-1kworker/u9:021:41:283
32339991714,2cyclictest7980-21kworker/u8:123:50:042
32339991714,2cyclictest7980-21kworker/u8:123:25:042
32339991714,2cyclictest6730-21kworker/u8:221:54:012
32339991714,2cyclictest29260-21kworker/u8:122:38:042
32339991714,2cyclictest2780-21kworker/u8:200:15:042
32339991714,2cyclictest27653-21kworker/u8:021:42:012
32339991714,2cyclictest26592-21kworker/u8:000:32:042
32339991714,2cyclictest23473-21kworker/u8:222:56:042
32339991714,2cyclictest13918-21kworker/u8:022:33:042
3233999170,15cyclictest0-21swapper/221:21:042
3233899178,7cyclictest0-21swapper/123:21:021
3233899177,8cyclictest30585-21munin-node1
3233899175,3cyclictest4008-21cron20:40:001
3233899175,3cyclictest25792-21fschecks_count22:30:131
3233899171,6cyclictest0-21swapper/121:32:561
3233899171,3cyclictest16458-21munin-node1
3233899171,3cyclictest0-21swapper/122:50:191
3233899171,3cyclictest0-21swapper/122:10:141
3233899171,3cyclictest0-21swapper/121:44:281
3233899171,3cyclictest0-21swapper/100:10:121
32338991712,4cyclictest0-21swapper/122:35:191
3233899171,14cyclictest0-21swapper/121:06:031
3233899170,3cyclictest0-21swapper/100:25:141
3233899170,2cyclictest0-21swapper/120:10:101
3233899170,16cyclictest0-21swapper/123:01:031
3233899170,15cyclictest15976-21diskmemload00:09:171
3233899170,15cyclictest0-21swapper/120:15:181
3233899170,11cyclictest0-21swapper/123:30:011
32340991613,2cyclictest22452-21kworker/u8:121:17:043
32339991613,2cyclictest8185-21kworker/u8:122:11:042
32339991613,2cyclictest493-21kworker/u8:121:33:042
32339991613,2cyclictest27556-21kworker/u8:223:18:042
32339991613,2cyclictest24574-21kworker/u8:120:23:042
32339991613,2cyclictest2225-21kworker/u8:220:46:052
32339991613,2cyclictest2225-21kworker/u8:220:46:052
32339991613,2cyclictest19534-21kworker/u8:023:10:052
32339991613,2cyclictest16324-21kworker/u8:119:52:042
3233999160,15cyclictest0-21swapper/223:21:042
3233899165,3cyclictest0-21swapper/121:50:101
3233899164,3cyclictest9259-21sh21:36:261
3233899164,3cyclictest3592-21sh23:51:121
3233899164,3cyclictest20092-21ssh21:49:271
3233899164,3cyclictest1446-21ssh22:04:121
3233899164,3cyclictest13382-21grep21:01:011
3233899164,3cyclictest0-21swapper/119:45:001
3233899161,6cyclictest0-21swapper/123:41:081
3233899161,6cyclictest0-21swapper/123:36:391
3233899161,5cyclictest0-21swapper/123:18:301
3233899161,5cyclictest0-21swapper/123:06:331
3233899161,5cyclictest0-21swapper/122:26:531
3233899161,3cyclictest29960-21tr23:10:131
3233899161,3cyclictest0-21swapper/123:55:281
3233899161,2cyclictest0-21swapper/100:36:201
3233899160,3cyclictest0-21swapper/119:20:171
3233899160,2cyclictest0-21swapper/119:31:131
3233899160,14cyclictest0-21swapper/122:05:121
32340991512,2cyclictest5520-21kworker/u8:121:10:013
32340991512,2cyclictest14304-21kworker/u8:023:29:043
32340991512,2cyclictest0-21swapper/322:35:173
32340991511,2cyclictest0-21swapper/300:09:483
3234099150,13cyclictest26079-21processes23:05:173
32339991512,2cyclictest7980-21kworker/u8:123:45:042
32339991512,2cyclictest7980-21kworker/u8:123:45:042
32339991512,2cyclictest7980-21kworker/u8:123:33:042
32339991512,2cyclictest7399-21kworker/u8:219:38:042
32339991512,2cyclictest2780-21kworker/u8:200:00:042
32339991512,2cyclictest18463-21kworker/u8:020:37:042
32339991512,2cyclictest16324-21kworker/u8:120:01:042
32339991512,2cyclictest1441-21kworker/u8:100:38:052
32339991512,2cyclictest13359-21kworker/u8:019:25:042
32339991512,2cyclictest13359-21kworker/u8:019:23:042
32339991512,2cyclictest13359-21kworker/u8:019:10:042
32339991512,2cyclictest10492-21kworker/u8:019:45:042
3233899156,2cyclictest0-21swapper/119:15:021
3233899154,3cyclictest0-21swapper/120:55:141
3233899153,3cyclictest207150irq/24-eth120:40:171
3233899152,7cyclictest0-21swapper/119:10:001
3233899151,4cyclictest3728-21runrttasks20:45:091
3233899151,4cyclictest3728-21runrttasks20:45:091
3233899151,3cyclictest0-21swapper/120:20:161
3233899151,3cyclictest0-21swapper/120:00:141
3233899151,3cyclictest0-21swapper/119:45:151
3233899151,3cyclictest0-21swapper/119:25:151
3233899151,12cyclictest0-21swapper/120:10:001
32337991512,2cyclictest26592-21kworker/u8:000:28:040
188302150,2sleep30-21swapper/321:47:223
32340991411,2cyclictest27653-21kworker/u8:021:25:043
32340991411,2cyclictest0-21swapper/322:01:573
32340991411,2cyclictest0-21swapper/300:30:173
3234099140,2cyclictest0-21swapper/323:30:123
3234099140,13cyclictest0-21swapper/300:25:073
3234099140,12cyclictest0-21swapper/323:37:373
3233999142,2cyclictest3862-21ssh00:27:042
32339991411,2cyclictest6730-21kworker/u8:221:49:042
32339991411,2cyclictest6730-21kworker/u8:221:38:012
32339991411,2cyclictest2780-21kworker/u8:223:58:042
32339991411,2cyclictest2225-21kworker/u8:220:53:042
32339991411,2cyclictest2225-21kworker/u8:220:53:042
32339991411,2cyclictest21458-21kworker/u8:100:11:042
32339991411,2cyclictest19534-21kworker/u8:023:06:042
32339991411,2cyclictest18463-21kworker/u8:020:19:042
32339991411,2cyclictest14304-21kworker/u8:023:35:042
3233999141,11cyclictest0-21swapper/220:10:042
3233999140,2cyclictest0-21swapper/200:24:052
3233999140,12cyclictest0-21swapper/222:21:222
32337991411,2cyclictest2780-21kworker/u8:200:02:040
32337991410,2cyclictest0-21swapper/020:30:000
3233799140,12cyclictest402-21sh22:02:300
3233799140,12cyclictest0-21swapper/022:05:160
3234099139,2cyclictest0-21swapper/322:07:543
3234099137,4cyclictest23811-21ssh21:52:543
32340991310,2cyclictest8185-21kworker/u8:122:13:043
32340991310,2cyclictest29546-21kworker/u8:023:47:043
32340991310,2cyclictest29546-21kworker/u8:023:47:043
32340991310,2cyclictest23473-21kworker/u8:222:46:043
32340991310,2cyclictest18463-21kworker/u8:019:56:043
32340991310,2cyclictest1441-21kworker/u8:100:35:043
32340991310,2cyclictest10108-21kworker/u8:021:03:043
3234099130,2cyclictest30859-21ssh23:10:273
3234099130,2cyclictest0-21swapper/323:43:073
3234099130,2cyclictest0-21swapper/323:16:043
3234099130,2cyclictest0-21swapper/321:20:473
3234099130,2cyclictest0-21swapper/320:01:023
3234099130,2cyclictest0-21swapper/300:20:383
3234099130,2cyclictest0-21swapper/300:04:583
3234099130,12cyclictest0-21swapper/322:15:363
3234099130,12cyclictest0-21swapper/321:34:273
3234099130,12cyclictest0-21swapper/319:10:183
3234099130,12cyclictest0-21swapper/300:19:363
32339991310,2cyclictest2225-21kworker/u8:220:44:042
32339991310,2cyclictest10492-21kworker/u8:019:41:042
32339991310,2cyclictest0-21swapper/222:00:122
3233999130,2cyclictest0-21swapper/223:00:172
3233999130,2cyclictest0-21swapper/222:47:042
3233999130,2cyclictest0-21swapper/222:42:332
3233999130,2cyclictest0-21swapper/221:15:002
3233999130,2cyclictest0-21swapper/221:00:152
3233999130,12cyclictest0-21swapper/222:16:062
3233999130,12cyclictest0-21swapper/219:55:152
32337991310,2cyclictest0-21swapper/021:52:010
32337991310,2cyclictest0-21swapper/020:50:100
32337991310,2cyclictest0-21swapper/020:50:100
3233799130,2cyclictest15976-21diskmemload23:16:290
3233799130,12cyclictest0-21swapper/021:20:110
3233799130,11cyclictest0-21swapper/022:14:570
292732130,2sleep015976-21diskmemload23:45:030
292732130,2sleep015976-21diskmemload23:45:030
3234099129,2cyclictest24574-21kworker/u8:120:27:043
3234099129,2cyclictest18698-21kworker/u8:122:26:043
3234099129,2cyclictest18463-21kworker/u8:020:18:043
3234099129,2cyclictest11525-21kworker/u8:123:03:043
3234099129,2cyclictest10492-21kworker/u8:019:48:043
3234099129,2cyclictest0-21swapper/323:20:143
3234099129,2cyclictest0-21swapper/321:38:033
3234099122,7cyclictest4562-21gdm-simple-gree20:42:593
3234099120,2cyclictest0-21swapper/323:54:483
3234099120,11cyclictest0-21swapper/323:58:273
3234099120,11cyclictest0-21swapper/322:50:253
3234099120,11cyclictest0-21swapper/322:30:043
3234099120,11cyclictest0-21swapper/322:22:203
3234099120,11cyclictest0-21swapper/320:45:143
3234099120,11cyclictest0-21swapper/320:45:143
3234099120,11cyclictest0-21swapper/319:35:133
3234099120,10cyclictest0-21swapper/300:12:303
3233999129,2cyclictest18463-21kworker/u8:020:06:042
3233999129,2cyclictest0-21swapper/222:25:192
3233999120,2cyclictest0-21swapper/221:58:052
3233999120,11cyclictest0-21swapper/222:50:032
3233999120,11cyclictest0-21swapper/222:05:522
3233799129,2cyclictest6730-21kworker/u8:221:39:040
3233799129,2cyclictest32455-21ssh23:12:270
3233799129,2cyclictest0-21swapper/023:58:400
3233799129,2cyclictest0-21swapper/023:27:180
3233799129,2cyclictest0-21swapper/023:08:070
3233799129,2cyclictest0-21swapper/022:45:190
3233799129,2cyclictest0-21swapper/022:15:140
3233799129,2cyclictest0-21swapper/021:11:410
3233799129,2cyclictest0-21swapper/020:20:110
3233799129,2cyclictest0-21swapper/019:40:110
3233799129,2cyclictest0-21swapper/000:36:520
3233799129,2cyclictest0-21swapper/000:31:180
3233799120,2cyclictest32011-21ssh22:36:290
3233799120,2cyclictest15976-21diskmemload22:52:280
3233799120,2cyclictest0-21swapper/023:34:570
3233799120,2cyclictest0-21swapper/022:25:180
3233799120,2cyclictest0-21swapper/022:23:090
3233799120,2cyclictest0-21swapper/021:26:500
3233799120,2cyclictest0-21swapper/000:10:090
3233799120,11cyclictest3412-21ssh21:30:210
3233799120,11cyclictest0-21swapper/023:52:270
3233799120,11cyclictest0-21swapper/023:36:200
3233799120,11cyclictest0-21swapper/022:56:580
3233799120,11cyclictest0-21swapper/022:31:390
3233799120,11cyclictest0-21swapper/019:50:000
276892120,1sleep00-21swapper/000:18:020
3234099118,2cyclictest5520-21kworker/u8:121:07:043
3234099118,2cyclictest29260-21kworker/u8:122:41:033
3234099118,2cyclictest16324-21kworker/u8:119:54:043
3234099118,2cyclictest13359-21kworker/u8:019:20:043
3234099118,2cyclictest10492-21kworker/u8:019:42:043
3234099118,2cyclictest0-21swapper/320:50:053
3234099118,2cyclictest0-21swapper/320:50:053
3234099112,7cyclictest0-21swapper/320:10:593
3234099110,7cyclictest0-21swapper/320:36:043
3234099110,7cyclictest0-21swapper/319:19:043
3233999110,1cyclictest0-21swapper/220:30:562
3233799118,2cyclictest0-21swapper/023:40:400
3233799118,2cyclictest0-21swapper/023:20:110
3233799118,2cyclictest0-21swapper/021:56:210
3233799118,2cyclictest0-21swapper/021:16:280
3233799118,2cyclictest0-21swapper/019:25:170
3233799110,2cyclictest0-21swapper/022:42:510
3233799110,10cyclictest18463-21kworker/u8:020:31:040
3233799110,10cyclictest0-21swapper/000:22:390
3233799110,10cyclictest0-21swapper/000:05:490
129912110,1sleep00-21swapper/021:40:450
3234099107,2cyclictest0-21swapper/319:30:273
3234099104,4cyclictest28066-1kworker/3:2H20:24:313
3234099102,7cyclictest0-21swapper/320:57:593
3233799107,2cyclictest0-21swapper/020:15:120
3233799107,2cyclictest0-21swapper/019:45:050
3233799100,2cyclictest0-21swapper/023:00:310
323409994,3cyclictest22487-21date20:05:003
323399995,2cyclictest0-21swapper/220:25:052
323399994,3cyclictest9821-21grep19:31:152
323399993,4cyclictest2232-21head19:15:132
323379996,2cyclictest7399-21kworker/u8:219:36:040
323379996,2cyclictest22149-21kworker/u8:220:10:040
323379996,2cyclictest19203-21latency19:55:160
323379996,2cyclictest1882-21apt-get19:15:070
323379995,2cyclictest22662-21telnet20:05:130
323379994,3cyclictest4764-21fschecks_count20:40:140
323379994,3cyclictest1266-21swap19:11:030
13709290,2sleep00-21swapper/021:01:500
323409983,3cyclictest6507-21sh19:25:143
323409983,3cyclictest0-21swapper/320:30:133
323399983,3cyclictest14340-21aten2.4-expect21:05:142
323399983,3cyclictest10901-21fschecks_time20:55:152
323379985,2cyclictest0-21swapper/019:24:570
323379984,2cyclictest101ktimersoftd/020:45:110
323379984,2cyclictest101ktimersoftd/020:45:110
323379983,3cyclictest21492-21cut20:00:280
323379980,7cyclictest0-21swapper/021:07:200
323379980,6cyclictest2317-21aten2.4-expect20:35:110
323379973,3cyclictest3158-21dbus-daemon20:55:100
323379970,6cyclictest0-21swapper/019:30:040
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional