You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-25 - 06:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Tue Nov 25, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
15166212094,18sleep10-21swapper/119:05:201
15983211897,16sleep20-21swapper/219:09:012
16011211192,13sleep30-21swapper/319:09:223
1266221040,1sleep212661-21ssh21:22:262
15735210178,18sleep00-21swapper/019:05:510
307812710,1sleep10-21swapper/123:20:461
35602590,1sleep10-21swapper/122:20:131
242572550,1sleep00-21swapper/000:21:100
16087993817,19cyclictest0-21swapper/019:40:140
1608999360,18cyclictest0-21swapper/221:30:132
16089993515,2cyclictest11205-21ssh23:35:132
99632340,1sleep10-21swapper/121:53:151
16087993312,19cyclictest0-21swapper/019:25:120
294802290,0sleep10-21swapper/122:13:361
236782270,0sleep30-21swapper/322:07:043
1608999240,7cyclictest0-21swapper/223:45:112
1608899221,3cyclictest0-21swapper/120:00:121
16088992118,2cyclictest0-21swapper/123:55:131
16088992118,2cyclictest0-21swapper/123:55:121
1608899210,2cyclictest0-21swapper/120:35:121
264212200,1sleep1221ktimersoftd/123:16:291
1608799201,17cyclictest12951-21ssh22:30:110
1608799200,2cyclictest0-21swapper/023:35:130
163572190,1sleep337-21rcuc/300:13:513
16088991815,2cyclictest28095-21kworker/u8:100:02:041
1609099170,2cyclictest0-21swapper/323:35:133
16088991710,5cyclictest32199-21diskmemload22:40:041
1608799175,2cyclictest0-21swapper/023:45:110
1608799170,15cyclictest0-21swapper/022:10:120
1609099160,12cyclictest0-21swapper/319:59:553
16088991613,2cyclictest7906-21kworker/u8:200:07:041
16088991613,2cyclictest24425-21kworker/u8:221:55:041
1608799160,14cyclictest0-21swapper/023:21:080
16090991510,3cyclictest0-21swapper/323:21:553
1609099150,3cyclictest6841-21cpuspeed_turbos21:50:123
16089991512,2cyclictest0-21swapper/222:26:562
16089991512,2cyclictest0-21swapper/221:19:072
1608999151,12cyclictest22850-21perl00:20:172
16088991512,2cyclictest13762-21kworker/u8:123:40:011
16088991512,2cyclictest11787-21kworker/u8:021:34:041
16088991510,4cyclictest11787-21kworker/u8:021:25:041
16088991510,3cyclictest0-21swapper/121:10:141
16088991510,3cyclictest0-21swapper/100:10:191
1608899150,13cyclictest0-21swapper/123:50:271
1608899150,10cyclictest0-21swapper/119:42:041
1608799152,7cyclictest0-21swapper/020:20:000
1608799152,7cyclictest0-21swapper/020:10:000
1608799151,3cyclictest23055-21df_inode22:40:130
16087991511,2cyclictest313322sleep021:41:200
1608799151,12cyclictest26890-21perl20:55:150
1608799150,3cyclictest0-21swapper/000:38:340
1608799150,13cyclictest8167-21basename22:25:120
1608799150,13cyclictest32199-21diskmemload22:00:170
1608799150,13cyclictest0-21swapper/022:16:170
1608799150,13cyclictest0-21swapper/021:48:480
1608799150,13cyclictest0-21swapper/021:24:030
1609099149,3cyclictest4631-21munin-node3
1609099149,3cyclictest20737-21diskstats19:20:143
16090991411,2cyclictest0-21swapper/323:45:453
16090991411,2cyclictest0-21swapper/322:50:553
16090991411,2cyclictest0-21swapper/322:26:163
16090991411,2cyclictest0-21swapper/321:57:463
16090991410,2cyclictest22267-21apt-get22:40:063
1609099140,3cyclictest7059-21if_eth023:30:173
1609099140,2cyclictest0-21swapper/322:10:163
1609099140,2cyclictest0-21swapper/321:30:263
1609099140,2cyclictest0-21swapper/300:18:553
1609099140,12cyclictest11071-21cat23:00:273
16089991411,2cyclictest32199-21diskmemload00:11:162
16089991411,2cyclictest0-21swapper/221:48:062
16089991411,2cyclictest0-21swapper/200:19:062
1608999140,2cyclictest0-21swapper/200:36:062
1608999140,12cyclictest0-21swapper/223:41:562
1608999140,12cyclictest0-21swapper/223:20:492
1608999140,12cyclictest0-21swapper/222:23:242
1608999140,12cyclictest0-21swapper/222:08:142
1608999140,12cyclictest0-21swapper/219:15:142
1608899149,3cyclictest32199-21diskmemload23:10:081
16088991411,2cyclictest7906-21kworker/u8:200:22:051
16088991411,2cyclictest4756-21kworker/u8:121:19:051
16088991411,2cyclictest24526-21kworker/u8:219:47:041
16088991411,2cyclictest1283-21kworker/u8:000:15:051
16088991411,2cyclictest11733-21kworker/u8:219:20:041
16088991410,2cyclictest21-21rcuc/119:50:161
1608899140,3cyclictest17635-21sed22:00:241
1608899140,12cyclictest32199-21diskmemload22:35:161
1608899140,12cyclictest0-21swapper/123:05:121
1608899140,12cyclictest0-21swapper/121:40:141
1608899140,12cyclictest0-21swapper/119:10:141
1608799149,3cyclictest0-21swapper/000:31:070
16087991411,2cyclictest0-21swapper/023:08:070
16087991411,2cyclictest0-21swapper/000:06:570
1608799140,3cyclictest29095-21chrt00:26:150
1608799140,2cyclictest32199-21diskmemload21:53:370
1608799140,12cyclictest5129-21runrttasks23:42:570
1608799140,12cyclictest32199-21diskmemload22:52:340
1608799140,12cyclictest32199-21diskmemload22:48:580
1608799140,12cyclictest0-21swapper/021:30:500
1608799140,12cyclictest0-21swapper/021:12:530
1608799140,12cyclictest0-21swapper/000:15:180
1609099138,3cyclictest14992-21fschecks_count23:05:133
1609099132,6cyclictest0-21swapper/319:50:003
16090991310,2cyclictest16433-21ssh22:33:253
16090991310,2cyclictest0-21swapper/323:19:163
16090991310,2cyclictest0-21swapper/322:00:103
16090991310,2cyclictest0-21swapper/300:28:463
16090991310,2cyclictest0-21swapper/300:05:193
1609099130,2cyclictest0-21swapper/323:57:053
1609099130,2cyclictest0-21swapper/323:57:053
1609099130,2cyclictest0-21swapper/323:41:363
1609099130,12cyclictest0-21swapper/323:52:353
1609099130,12cyclictest0-21swapper/322:56:353
1609099130,12cyclictest0-21swapper/322:46:453
1609099130,12cyclictest0-21swapper/321:37:163
1609099130,12cyclictest0-21swapper/300:24:353
16089991310,2cyclictest32199-21diskmemload23:01:112
16089991310,2cyclictest32199-21diskmemload22:15:132
16089991310,2cyclictest32199-21diskmemload00:02:062
16089991310,2cyclictest0-21swapper/222:50:562
16089991310,2cyclictest0-21swapper/222:46:262
16089991310,2cyclictest0-21swapper/222:43:172
16089991310,2cyclictest0-21swapper/222:36:092
16089991310,2cyclictest0-21swapper/221:43:072
16089991310,2cyclictest0-21swapper/221:10:042
16089991310,2cyclictest0-21swapper/220:43:212
16089991310,2cyclictest0-21swapper/220:00:162
16089991310,2cyclictest0-21swapper/200:27:362
1608999130,2cyclictest0-21swapper/222:57:462
1608999130,2cyclictest0-21swapper/221:55:462
1608999130,2cyclictest0-21swapper/220:55:142
1608999130,12cyclictest0-21swapper/223:56:362
1608999130,12cyclictest0-21swapper/223:56:362
1608999130,12cyclictest0-21swapper/223:30:152
1608999130,12cyclictest0-21swapper/223:26:262
1608999130,12cyclictest0-21swapper/221:25:172
1608999130,12cyclictest0-21swapper/200:32:262
1608999130,12cyclictest0-21swapper/200:07:362
1608999130,11cyclictest32199-21diskmemload23:15:492
1608999130,11cyclictest32199-21diskmemload21:36:462
1608999130,11cyclictest0-21swapper/222:30:542
16088991310,2cyclictest8234-21kworker/u8:020:11:041
16088991310,2cyclictest332250irq/24-eth100:35:231
16088991310,2cyclictest14234-21kworker/u8:120:53:041
16088991310,2cyclictest0-21swapper/122:35:001
16088991310,2cyclictest0-21swapper/122:05:141
1608899130,5cyclictest0-21swapper/123:02:051
1608899130,12cyclictest0-21swapper/123:35:181
1608899130,12cyclictest0-21swapper/122:25:241
1608899130,12cyclictest0-21swapper/100:30:171
1608899130,11cyclictest0-21swapper/123:47:041
1608899130,11cyclictest0-21swapper/123:27:441
1608799138,3cyclictest0-21swapper/022:37:020
16087991310,2cyclictest0-21swapper/023:28:470
16087991310,2cyclictest0-21swapper/023:10:150
16087991310,2cyclictest0-21swapper/022:55:530
16087991310,2cyclictest0-21swapper/022:23:190
16087991310,2cyclictest0-21swapper/021:28:580
16087991310,2cyclictest0-21swapper/000:04:570
1608799130,2cyclictest32199-21diskmemload21:38:250
1608799130,2cyclictest0-21swapper/023:56:220
1608799130,2cyclictest0-21swapper/023:56:210
1608799130,2cyclictest0-21swapper/023:32:370
1608799130,2cyclictest0-21swapper/021:17:400
1608799130,12cyclictest0-21swapper/023:52:070
1608799130,12cyclictest0-21swapper/023:15:170
1608799130,12cyclictest0-21swapper/022:09:290
1608799130,12cyclictest0-21swapper/000:11:270
1608799130,11cyclictest13244-21ssh21:55:530
1608799130,11cyclictest0-21swapper/023:01:120
68162120,1sleep30-21swapper/322:23:333
228692120,2sleep222868-21fschecks_time20:45:152
1609099129,2cyclictest0-21swapper/322:36:053
1609099129,2cyclictest0-21swapper/321:49:263
1609099129,2cyclictest0-21swapper/321:22:303
1609099129,2cyclictest0-21swapper/321:12:463
1609099129,2cyclictest0-21swapper/319:30:273
1609099122,6cyclictest32199-21diskmemload22:20:013
1609099120,2cyclictest0-21swapper/320:40:163
1608999129,2cyclictest0-21swapper/223:05:092
1608999129,2cyclictest0-21swapper/222:00:162
1608999129,2cyclictest0-21swapper/220:30:162
1608999129,2cyclictest0-21swapper/219:45:252
1608999122,7cyclictest0-21swapper/221:08:582
1608999122,7cyclictest0-21swapper/219:31:582
1608999120,2cyclictest0-21swapper/223:10:002
1608999120,11cyclictest32199-21diskmemload21:51:402
1608999120,11cyclictest0-21swapper/223:50:342
1608999120,11cyclictest0-21swapper/222:10:122
1608999120,11cyclictest0-21swapper/219:23:212
1608899129,2cyclictest24526-21kworker/u8:220:28:041
1608899129,2cyclictest24526-21kworker/u8:219:37:041
1608899129,2cyclictest21970-21kworker/u8:019:27:051
1608899129,2cyclictest14234-21kworker/u8:120:32:041
1608899129,2cyclictest0-21swapper/122:50:131
1608899129,2cyclictest0-21swapper/122:47:171
1608899129,2cyclictest0-21swapper/121:36:231
1608899129,2cyclictest0-21swapper/121:00:131
1608899129,2cyclictest0-21swapper/120:45:151
1608899127,3cyclictest6645-21tr23:30:161
1608899120,8cyclictest0-21swapper/121:46:011
1608899120,3cyclictest6104-21swap22:55:251
1608899120,3cyclictest0-21swapper/119:30:171
1608899120,2cyclictest0-21swapper/120:20:141
1608899120,11cyclictest0-21swapper/122:15:221
1608899120,11cyclictest0-21swapper/121:20:161
1608899120,11cyclictest0-21swapper/120:05:121
1608899120,10cyclictest0-21swapper/120:40:231
1608799129,2cyclictest30411-21apt-get19:45:110
1608799129,2cyclictest0-21swapper/021:05:260
1608799129,2cyclictest0-21swapper/020:30:000
1608799125,4cyclictest101ktimersoftd/019:55:000
1608799122,5cyclictest0-21swapper/019:35:000
1608799120,2cyclictest0-21swapper/020:45:120
1608799120,2cyclictest0-21swapper/019:50:180
1608799120,11cyclictest0-21swapper/020:40:140
1608799120,11cyclictest0-21swapper/020:15:290
1608799120,11cyclictest0-21swapper/020:05:250
1608799120,11cyclictest0-21swapper/019:15:140
183062110,1sleep30-21swapper/319:15:113
1609099118,2cyclictest32199-21diskmemload21:40:583
1609099118,2cyclictest0-21swapper/321:27:333
1609099118,2cyclictest0-21swapper/300:00:063
1609099117,2cyclictest26683-21df19:35:163
1609099116,3cyclictest278-21jbd2/sda1-823:25:043
1609099116,3cyclictest21819-21ssh23:11:473
1609099113,6cyclictest0-21swapper/321:00:233
1609099113,6cyclictest0-21swapper/319:40:253
1609099112,5cyclictest0-21swapper/320:10:003
1609099112,5cyclictest0-21swapper/320:05:013
1609099111,6cyclictest0-21swapper/320:40:003
1609099111,5cyclictest0-21swapper/320:13:583
1609099110,9cyclictest32199-21diskmemload00:30:333
1609099110,2cyclictest0-21swapper/321:16:563
1608999118,2cyclictest0-21swapper/220:25:122
1608999113,6cyclictest0-21swapper/220:20:252
1608999112,7cyclictest0-21swapper/220:35:012
1608999110,10cyclictest0-21swapper/221:01:442
1608999110,10cyclictest0-21swapper/219:35:172
1608899111,8cyclictest1970-21apt-get19:55:111
1608899110,9cyclictest0-21swapper/121:05:161
1608899110,9cyclictest0-21swapper/120:55:141
1608899110,10cyclictest0-21swapper/100:26:581
1608799118,2cyclictest0-21swapper/019:35:190
1608799110,9cyclictest0-21swapper/020:26:550
1609099107,2cyclictest21810-21munin-node19:25:263
1609099105,3cyclictest23217-21awk20:45:183
1609099105,3cyclictest0-21swapper/320:55:153
1608999106,2cyclictest24628-21tr20:50:142
1608999105,3cyclictest8563-21df20:10:142
1608999105,3cyclictest6217-21aten2.4_r3power20:05:112
1608999102,7cyclictest0-21swapper/220:16:012
1608999102,7cyclictest0-21swapper/219:56:012
1608999102,7cyclictest0-21swapper/219:13:012
1608999102,6cyclictest0-21swapper/219:50:592
1608999100,7cyclictest0-21swapper/219:43:012
1608899100,8cyclictest10208-21munin-node1
1608899100,2cyclictest0-21swapper/119:15:051
1608799107,2cyclictest0-21swapper/020:35:160
1608799107,2cyclictest0-21swapper/019:20:130
1608799105,3cyclictest25714-21unixbench_multi20:50:250
160909995,2cyclictest10352-21aten2.4_r3power20:15:153
160909994,3cyclictest32741-21df_abs19:50:153
160909994,3cyclictest25359-21pzem_energy20:50:213
160909994,3cyclictest16522-21cpuspeed_turbos20:30:133
160909994,3cyclictest15163-21open_inodes20:25:193
160909994,3cyclictest12342-21cut20:20:133
160899996,2cyclictest0-21swapper/219:25:242
160879994,3cyclictest28426-21telnet21:00:110
160879994,3cyclictest16584-21grep19:10:140
160909983,3cyclictest4366-21nscd19:10:123
160909983,3cyclictest30462-21aten2.4-expect21:05:123
160879983,3cyclictest4294-21cpuspeed_turbos20:00:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional