You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-01 - 08:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Mon Dec 01, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
7412212099,16sleep00-21swapper/019:09:570
268021100,1sleep10-21swapper/123:05:171
5519210897,6sleep30-21swapper/319:05:073
7184210796,6sleep20-21swapper/219:07:032
7064210380,17sleep10-21swapper/119:05:301
12242830,0sleep20-21swapper/221:55:142
202382750,0sleep20-21swapper/200:35:002
69752740,0sleep20-21swapper/223:44:462
198562720,1sleep00-21swapper/022:15:000
249772710,1sleep10-21swapper/119:50:281
228052240,1sleep10-21swapper/121:05:241
264112230,0sleep10-21swapper/122:20:391
744399220,20cyclictest0-21swapper/221:00:112
744199221,19cyclictest0-21swapper/021:25:130
744199219,11cyclictest0-21swapper/019:15:130
7441992118,2cyclictest7655-21kworker/u8:119:24:050
7441992118,2cyclictest29898-21kworker/u8:020:11:050
7441992118,2cyclictest23854-21kworker/u8:219:52:040
744199210,4cyclictest0-21swapper/021:42:050
744199210,2cyclictest0-21swapper/019:10:140
7444992017,2cyclictest27175-21kworker/u8:122:56:043
744399200,18cyclictest0-21swapper/220:35:132
744199201,18cyclictest9-21ksoftirqd/000:06:060
744199200,4cyclictest0-21swapper/023:27:040
744199200,15cyclictest0-21swapper/021:20:050
7442991913,5cyclictest14977-21kworker/u8:121:39:041
744199192,2cyclictest0-21swapper/023:11:040
744199192,2cyclictest0-21swapper/022:52:020
744199192,2cyclictest0-21swapper/021:52:020
744199192,12cyclictest0-21swapper/000:13:040
7441991916,2cyclictest7655-21kworker/u8:120:04:040
7441991916,2cyclictest7655-21kworker/u8:119:25:040
7441991916,2cyclictest5604-21kworker/u8:021:45:050
7441991916,2cyclictest32170-21kworker/u8:200:16:060
7441991916,2cyclictest21330-21kworker/u8:021:07:050
7441991916,2cyclictest19895-21kworker/u8:019:45:050
7441991916,2cyclictest19360-21kworker/u8:022:21:050
7441991916,2cyclictest1553-21kworker/u8:220:20:050
7444991815,2cyclictest6082-21kworker/u8:122:11:053
7444991815,2cyclictest5788-21kworker/u8:023:40:063
7444991815,2cyclictest27175-21kworker/u8:123:14:043
7444991815,2cyclictest17787-21kworker/u8:121:18:053
744499181,3cyclictest0-21swapper/320:15:173
7441991815,2cyclictest9627-21kworker/u8:220:48:050
7441991815,2cyclictest6602-21kworker/u8:000:32:060
7441991815,2cyclictest5574-21kworker/u8:120:38:020
7441991815,2cyclictest27024-21kworker/u8:321:13:050
7441991815,2cyclictest19360-21kworker/u8:022:29:040
7441991815,2cyclictest17787-21kworker/u8:121:00:050
7441991815,2cyclictest17337-21kworker/u8:219:36:050
7441991815,2cyclictest15237-21kworker/u8:100:03:050
7441991815,2cyclictest15237-21kworker/u8:100:03:040
7441991815,2cyclictest13724-21kworker/u8:020:51:040
744199181,2cyclictest0-21swapper/021:15:040
7444991714,2cyclictest6602-21kworker/u8:000:29:053
7444991714,2cyclictest24868-21kworker/u8:122:23:043
7441991714,2cyclictest14081-21kworker/u8:023:00:040
744199171,2cyclictest0-21swapper/023:48:050
744199171,14cyclictest18270-21ssh21:38:200
744199171,12cyclictest0-21swapper/022:38:050
744199170,2cyclictest0-21swapper/023:06:020
744199170,2cyclictest0-21swapper/022:32:050
744199170,15cyclictest0-21swapper/022:18:060
7444991613,2cyclictest10064-21kworker/u8:223:52:023
744499160,14cyclictest0-21swapper/322:25:373
744499160,14cyclictest0-21swapper/321:13:363
744399160,14cyclictest23139-21unixbench_multi21:05:282
7442991613,2cyclictest27175-21kworker/u8:123:13:041
7442991613,2cyclictest20638-21kworker/u8:100:37:051
7442991613,2cyclictest17787-21kworker/u8:121:21:051
744299161,13cyclictest4166-21rsyslogd23:00:211
744299160,14cyclictest23583-21diskmemload23:22:361
744299160,14cyclictest0-21swapper/122:29:261
744299160,14cyclictest0-21swapper/100:30:251
744199160,2cyclictest0-21swapper/023:56:020
744199160,2cyclictest0-21swapper/022:59:050
744199160,2cyclictest0-21swapper/019:58:020
744199160,14cyclictest0-21swapper/023:18:510
744499151,3cyclictest4631-21ssh22:32:393
7444991512,2cyclictest5604-21kworker/u8:021:37:053
7444991512,2cyclictest27175-21kworker/u8:123:03:053
7444991512,2cyclictest0-21swapper/321:33:373
7444991512,2cyclictest0-21swapper/321:33:363
7444991511,2cyclictest23740-21kworker/u8:123:28:053
744499150,2cyclictest0-21swapper/321:26:163
744499150,13cyclictest0-21swapper/300:30:203
7443991512,2cyclictest0-21swapper/221:40:282
744399151,12cyclictest9883-21ls19:15:152
7443991511,2cyclictest6889-21sed22:00:182
744399151,12cyclictest23686-21ssh22:52:582
7442991512,2cyclictest27024-21kworker/u8:321:33:051
7442991512,2cyclictest27024-21kworker/u8:321:33:051
7442991512,2cyclictest21518-21kworker/u8:221:56:051
744299150,2cyclictest23583-21diskmemload23:30:261
744299150,13cyclictest0-21swapper/122:56:051
744299150,13cyclictest0-21swapper/121:51:071
744199151,12cyclictest10881-21apt-get22:40:050
744199150,2cyclictest0-21swapper/023:41:050
744199150,2cyclictest0-21swapper/023:23:050
744199150,2cyclictest0-21swapper/022:48:020
744199150,2cyclictest0-21swapper/022:05:050
744199150,2cyclictest0-21swapper/022:02:010
744199150,2cyclictest0-21swapper/021:58:050
744199150,2cyclictest0-21swapper/021:32:050
744199150,2cyclictest0-21swapper/021:32:050
744199150,2cyclictest0-21swapper/020:42:050
744199150,2cyclictest0-21swapper/020:27:040
744199150,2cyclictest0-21swapper/020:15:040
744199150,2cyclictest0-21swapper/019:34:050
744199150,2cyclictest0-21swapper/000:36:050
744499141,2cyclictest30341-21ssh23:35:073
7444991411,2cyclictest29898-21kworker/u8:020:28:023
7444991411,2cyclictest23583-21diskmemload22:08:483
7444991411,2cyclictest13142-21kworker/u8:222:18:023
7444991411,2cyclictest0-21swapper/300:36:373
744499140,3cyclictest6172-21grep00:20:003
744499140,2cyclictest0-21swapper/323:57:573
744499140,2cyclictest0-21swapper/323:18:473
744499140,2cyclictest0-21swapper/322:53:373
744499140,2cyclictest0-21swapper/321:45:373
744499140,2cyclictest0-21swapper/321:21:473
744499140,2cyclictest0-21swapper/300:06:563
744499140,13cyclictest0-21swapper/323:20:263
744499140,13cyclictest0-21swapper/322:44:173
744499140,13cyclictest0-21swapper/300:22:573
744499140,12cyclictest0-21swapper/320:40:133
744399149,3cyclictest0-21swapper/200:37:302
7443991411,2cyclictest0-21swapper/223:18:382
7443991411,2cyclictest0-21swapper/219:35:112
744399140,2cyclictest23583-21diskmemload00:07:572
744399140,2cyclictest0-21swapper/222:20:372
744399140,2cyclictest0-21swapper/221:37:482
744399140,2cyclictest0-21swapper/221:20:082
744399140,2cyclictest0-21swapper/220:55:282
744399140,2cyclictest0-21swapper/200:13:012
744399140,13cyclictest0-21swapper/222:19:182
744399140,13cyclictest0-21swapper/222:06:282
744399140,12cyclictest9660-21ssh00:23:052
744399140,12cyclictest9627-21kworker/u8:220:45:052
744399140,12cyclictest29898-21kworker/u8:020:30:052
744399140,12cyclictest23854-21kworker/u8:219:55:052
744399140,12cyclictest0-21swapper/200:01:512
744399140,12cyclictest0-21swapper/200:01:502
7442991411,2cyclictest27024-21kworker/u8:321:14:051
7442991411,2cyclictest0-21swapper/123:47:161
7442991411,2cyclictest0-21swapper/121:41:471
7442991411,2cyclictest0-21swapper/121:27:361
744299140,2cyclictest0-21swapper/123:39:451
744299140,2cyclictest0-21swapper/122:42:461
744299140,2cyclictest0-21swapper/122:09:061
744299140,13cyclictest0-21swapper/123:55:061
744299140,13cyclictest0-21swapper/122:36:051
744299140,12cyclictest0-21swapper/121:46:161
744299140,12cyclictest0-21swapper/100:15:151
744199142,7cyclictest0-21swapper/020:10:000
744199140,2cyclictest0-21swapper/023:53:040
744199140,2cyclictest0-21swapper/023:38:010
744199140,2cyclictest0-21swapper/023:30:060
744199140,2cyclictest0-21swapper/020:30:050
744199140,12cyclictest11055-21ssh00:25:020
64602141,3sleep16649-21hddtemp_smartct22:00:151
7444991310,2cyclictest29898-21kworker/u8:020:21:053
7444991310,2cyclictest24868-21kworker/u8:122:38:023
7444991310,2cyclictest23854-21kworker/u8:219:56:053
7444991310,2cyclictest21518-21kworker/u8:221:43:053
7444991310,2cyclictest18281-21kworker/u8:019:30:053
7444991310,2cyclictest18281-21kworker/u8:019:17:053
7444991310,2cyclictest18281-21kworker/u8:019:13:043
7444991310,2cyclictest17692-21ssh22:45:483
7444991310,2cyclictest17337-21kworker/u8:219:37:043
7444991310,2cyclictest0-21swapper/323:45:083
7444991310,2cyclictest0-21swapper/321:52:003
744499130,2cyclictest1243-21ssh00:14:583
744499130,2cyclictest0-21swapper/322:00:193
744499130,12cyclictest0-21swapper/323:30:283
744499130,12cyclictest0-21swapper/321:55:153
744499130,12cyclictest0-21swapper/300:02:273
744499130,12cyclictest0-21swapper/300:02:273
744499130,11cyclictest381ktimersoftd/323:05:153
7443991310,2cyclictest0-21swapper/223:25:032
7443991310,2cyclictest0-21swapper/223:21:092
7443991310,2cyclictest0-21swapper/223:05:482
7443991310,2cyclictest0-21swapper/223:00:112
7443991310,2cyclictest0-21swapper/222:59:392
7443991310,2cyclictest0-21swapper/222:45:122
7443991310,2cyclictest0-21swapper/222:35:122
7443991310,2cyclictest0-21swapper/222:33:282
7443991310,2cyclictest0-21swapper/222:11:392
7443991310,2cyclictest0-21swapper/221:47:572
7443991310,2cyclictest0-21swapper/220:20:282
744399130,2cyclictest25585-21ssh21:10:392
744399130,2cyclictest0-21swapper/223:45:372
744399130,2cyclictest0-21swapper/221:51:112
744399130,2cyclictest0-21swapper/221:15:512
744399130,2cyclictest0-21swapper/220:26:402
744399130,2cyclictest0-21swapper/220:00:252
744399130,12cyclictest0-21swapper/223:56:482
744399130,12cyclictest0-21swapper/223:50:412
744399130,12cyclictest0-21swapper/223:36:492
744399130,12cyclictest0-21swapper/223:31:282
744399130,12cyclictest0-21swapper/222:40:082
744399130,12cyclictest0-21swapper/222:25:582
744399130,12cyclictest0-21swapper/221:27:372
744399130,12cyclictest0-21swapper/219:30:142
7442991310,2cyclictest18281-21kworker/u8:019:27:041
7442991310,2cyclictest13142-21kworker/u8:222:10:051
7442991310,2cyclictest0-21swapper/122:17:151
7442991310,2cyclictest0-21swapper/119:55:121
7442991310,2cyclictest0-21swapper/100:20:111
744299130,2cyclictest0-21swapper/100:05:061
744299130,12cyclictest0-21swapper/123:40:061
744299130,12cyclictest0-21swapper/120:55:171
744299130,11cyclictest0-21swapper/122:52:301
744299130,11cyclictest0-21swapper/122:45:051
744299130,11cyclictest0-21swapper/120:00:131
744199130,2cyclictest0-21swapper/000:23:040
47392130,2sleep10-21swapper/122:32:511
744499129,2cyclictest7655-21kworker/u8:119:22:013
744499129,2cyclictest21330-21kworker/u8:021:08:053
744499129,2cyclictest19895-21kworker/u8:019:44:053
744499129,2cyclictest17787-21kworker/u8:120:57:053
744499129,2cyclictest13724-21kworker/u8:020:54:053
744499129,2cyclictest0-21swapper/320:32:173
744499120,2cyclictest0-21swapper/320:05:233
744399129,2cyclictest0-21swapper/219:20:162
744399129,2cyclictest0-21swapper/200:15:392
744399120,2cyclictest0-21swapper/221:30:032
744399120,2cyclictest0-21swapper/221:30:032
744399120,2cyclictest0-21swapper/220:06:322
744399120,11cyclictest7655-21kworker/u8:119:46:052
744399120,11cyclictest0-21swapper/223:11:482
744399120,11cyclictest0-21swapper/220:10:202
744399120,11cyclictest0-21swapper/200:26:552
744299129,2cyclictest7655-21kworker/u8:119:23:051
744299129,2cyclictest29898-21kworker/u8:020:08:051
744299125,2cyclictest332250irq/24-eth100:26:261
744299120,2cyclictest0-21swapper/121:17:461
744299120,2cyclictest0-21swapper/120:30:221
744299120,2cyclictest0-21swapper/120:20:191
744299120,2cyclictest0-21swapper/119:35:001
744299120,1cyclictest23583-21diskmemload00:01:461
744299120,1cyclictest23583-21diskmemload00:01:451
744299120,11cyclictest0-21swapper/123:16:051
744299120,11cyclictest0-21swapper/121:01:201
744299120,10cyclictest0-21swapper/123:25:131
744299120,10cyclictest0-21swapper/100:12:051
744199120,2cyclictest0-21swapper/020:58:050
744499118,2cyclictest9627-21kworker/u8:220:46:043
744499118,2cyclictest7655-21kworker/u8:120:02:053
744499118,2cyclictest7655-21kworker/u8:119:50:023
744499110,2cyclictest0-21swapper/321:00:163
744399110,2cyclictest0-21swapper/220:51:402
744299118,2cyclictest9627-21kworker/u8:220:49:051
744299118,2cyclictest9627-21kworker/u8:220:41:051
744299118,2cyclictest29898-21kworker/u8:020:25:041
744299118,2cyclictest1553-21kworker/u8:220:16:051
744299118,2cyclictest0-21swapper/119:45:141
744299110,9cyclictest9932-21cut19:15:151
744299110,2cyclictest0-21swapper/123:50:231
96292100,2sleep39489-21copy20:35:013
744499100,4cyclictest0-21swapper/319:27:053
744399102,7cyclictest0-21swapper/220:44:592
744399102,7cyclictest0-21swapper/219:50:022
744399102,7cyclictest0-21swapper/219:12:582
744299107,2cyclictest29898-21kworker/u8:020:10:021
744299100,9cyclictest0-21swapper/119:34:591
744299100,8cyclictest15740-21munin-node1
744299100,2cyclictest0-21swapper/120:35:141
744299100,2cyclictest0-21swapper/119:40:141
744199100,8cyclictest0-21swapper/019:41:050
74449990,8cyclictest0-21swapper/320:12:383
74439994,3cyclictest15049-21grep19:25:242
74439992,6cyclictest0-21swapper/220:15:592
74439990,6cyclictest0-21swapper/219:43:022
74449983,3cyclictest23105-21grep19:45:243
74429980,7cyclictest0-21swapper/119:10:201
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional