You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-23 - 20:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot3s.osadl.org (updated Tue Dec 23, 2025 12:45:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1340696997540,31cyclictest16950irq/224-800000007:39:590
1340701997330,38cyclictest1-21systemd07:19:591
134069699722,4cyclictest1354991-21munin-run11:45:010
134069699693,16cyclictest1345314-21apt-get08:36:170
1340696996927,37cyclictest16950irq/224-800000011:30:010
1340696996922,42cyclictest1350824-21sshd10:21:200
134069699691,5cyclictest238-21systemd-journal11:04:200
134069699691,10cyclictest1351644-21/usr/sbin/munin10:40:010
1340707996725,38cyclictest1347465-21latency_hist09:20:033
1340707996725,38cyclictest1347465-21latency_hist09:20:033
1340707996614,13cyclictest238-21systemd-journal08:29:593
1340705996542,16cyclictest238-21systemd-journal10:15:012
134070199657,53cyclictest1-21systemd07:25:011
134069699651,5cyclictest1353674-21modprobe11:20:000
1340707996425,33cyclictest275-21dbus-daemon10:40:013
134069699642,7cyclictest1355459-21sshd11:51:190
134069699642,6cyclictest1346946-21munin-run09:10:010
134069699641,11cyclictest1341693-21sshd07:27:210
134070799633,21cyclictest238-21systemd-journal11:20:013
1340707996315,14cyclictest275-21dbus-daemon07:35:023
1340696996338,22cyclictest16950irq/224-800000012:35:010
1340696996323,35cyclictest1343258-21modprobe08:00:000
134069699632,12cyclictest1341167-21sshd07:19:200
134069699631,7cyclictest274-21cron10:55:010
134070199622,16cyclictest1345903-21munin-run08:50:001
134069699622,7cyclictest1346383-21sshd08:58:210
134069699622,13cyclictest1355984-21sshd12:00:210
134069699622,13cyclictest1355984-21sshd12:00:200
134069699621,6cyclictest1342722-21sshd07:46:200
134069699621,5cyclictest1345916-21munin-run08:50:010
1340696996214,43cyclictest1348994-21sshd09:45:190
134070799613,15cyclictest1345639-21cron08:45:013
134070799613,15cyclictest1345639-21cron08:45:003
1340707996115,5cyclictest0-21swapper/308:36:173
1340705996125,13cyclictest1-21systemd09:10:012
134070199613,17cyclictest1356523-21latency_hist12:14:591
1340701996115,41cyclictest238-21systemd-journal08:19:211
134069699613,5cyclictest1356236-21sshd12:05:210
134069699612,5cyclictest1348761-21sshd09:44:210
134069699612,5cyclictest1347710-21sshd09:20:560
134069699612,13cyclictest1355244-21systemd-run11:50:000
134069699612,10cyclictest1340888-21sshd07:10:210
134069699612,10cyclictest1340888-21sshd07:10:200
1340707996021,8cyclictest37-21ksoftirqd/310:05:013
134070199602,16cyclictest1344572-21munin-run08:25:001
134070199602,13cyclictest1352147-21munin-run10:50:021
1340701996016,7cyclictest131rcu_preempt07:55:011
134070199601,14cyclictest1347436-21modprobe09:17:011
134070199601,14cyclictest1347436-21modprobe09:17:001
134069699602,5cyclictest1354431-21sshd11:31:230
134069699602,5cyclictest1342470-21sshd07:41:200
134069699602,4cyclictest1348226-21sshd09:33:210
134069699602,12cyclictest1352611-21sshd10:57:200
1340696996020,36cyclictest1344327-21true08:20:000
134069699601,5cyclictest1345617-21sshd08:40:200
134069699601,5cyclictest1345617-21sshd08:40:190
134070799597,11cyclictest0-21swapper/309:30:013
134070799594,12cyclictest1346924-21cron09:10:003
134070799593,19cyclictest1356770-21cron12:19:593
1340707995927,28cyclictest1-21systemd12:00:013
134070799592,17cyclictest1346447-21unin-run09:00:013
134070199596,48cyclictest1-21systemd12:35:011
1340701995926,29cyclictest1357059-21latency_hist12:25:031
1340701995922,32cyclictest238-21systemd-journal09:49:591
134070199592,13cyclictest1352643-21munin-run11:00:001
1340701995914,39cyclictest284-21systemd-logind09:05:011
1340701995914,39cyclictest284-21systemd-logind09:05:001
134069699599,46cyclictest1344001-21sshd08:10:430
134069699592,5cyclictest1347472-21munin-run09:20:010
134069699592,5cyclictest1347472-21munin-run09:20:010
134069699592,14cyclictest1350526-21sshd10:15:200
1340696995918,36cyclictest1340883-21date07:10:030
134069699591,5cyclictest1343501-21sshd08:01:200
134069699591,4cyclictest1352106-21sshd10:46:190
134069699591,11cyclictest1357791-21sshd12:37:210
1340707995814,5cyclictest0-21swapper/311:05:013
1340701995831,23cyclictest1-21systemd09:35:001
134070199582,14cyclictest1346965-21unin-run09:10:001
134070199581,10cyclictest1341930-21sshd07:30:191
134069699582,16cyclictest1344585-21munin-run08:25:020
134069699582,11cyclictest364-21snmpd09:36:030
134069699581,6cyclictest1345047-21sshd08:31:210
134069699581,5cyclictest1349539-21munin-run10:00:010
134070799573,18cyclictest1349562-21modprobe10:00:013
134070199574,13cyclictest238-21systemd-journal11:35:011
134070199571,14cyclictest1-21systemd08:30:011
134069699573,14cyclictest1350312-21munin-run10:15:010
134069699573,11cyclictest1346675-21modprobe09:05:000
134069699573,11cyclictest1346675-21modprobe09:05:000
134069699572,9cyclictest1356772-21cron12:19:590
134069699572,16cyclictest1353168-21grep11:10:010
134069699572,16cyclictest1353168-21grep11:10:010
134069699572,15cyclictest1347167-21sshd09:10:200
134069699572,10cyclictest1353415-21modprobe11:14:590
134069699572,10cyclictest1341943-21sshd07:32:200
1340696995716,37cyclictest12-21ksoftirqd/010:35:000
134069699571,4cyclictest1343758-21sshd08:08:210
134069699571,4cyclictest1343758-21sshd08:08:200
1340707995616,5cyclictest1341350-21latency_hist07:20:023
1340707995614,7cyclictest1356427-21sed12:10:023
134070199563,8cyclictest1343237-21cron07:59:591
1340701995631,22cyclictest23-21ksoftirqd/109:15:021
134070199562,17cyclictest1347970-21sshd09:27:201
134070199562,14cyclictest1355168-21wc11:45:031
134070199562,11cyclictest275-21dbus-daemon08:10:021
134070199562,11cyclictest275-21dbus-daemon08:10:011
1340701995619,33cyclictest1356745-21sshd12:16:211
134070199561,16cyclictest1346177-21wc08:55:021
134069699562,6cyclictest1355748-21munin-run12:00:010
134069699562,11cyclictest1349773-21sshd10:00:190
134069699561,5cyclictest1351103-21munin-run10:30:010
134069699561,4cyclictest1348003-21systemd-run09:30:010
134069699561,12cyclictest1357282-21sshd12:26:210
134070799558,6cyclictest131rcu_preempt09:40:013
134070799556,11cyclictest1354714-21sendmail11:39:593
134070799554,15cyclictest1342749-21munin-run07:50:003
134070799553,19cyclictest1357837-21sendmail12:40:013
134070799553,17cyclictest1350582-21grep10:19:593
1340707995523,4cyclictest1334098-21kworker/u8:007:39:593
134070799552,21cyclictest1353180-21munin-run11:10:023
134070799552,21cyclictest1353180-21munin-run11:10:023
1340707995515,8cyclictest238-21systemd-journal08:25:013
134070199552,11cyclictest1357802-21cron12:40:001
134070199551,12cyclictest1354063-21latency_hist11:25:011
134070199551,12cyclictest1345631-21sshd08:43:211
134070199551,12cyclictest1345631-21sshd08:43:211
134069699552,5cyclictest1354753-21munin-run11:40:000
134069699551,13cyclictest1356507-21sshd12:14:210
1340696995511,39cyclictest1357044-21sshd12:24:210
134070799543,15cyclictest1356043-21latency_hist12:05:023
134070799543,15cyclictest1356043-21latency_hist12:05:013
134070799543,14cyclictest1350986-21latency_hist10:25:023
134070799542,16cyclictest1356548-21wc12:15:013
134070799542,16cyclictest1348246-21munin-plugin-st09:35:003
134070199543,16cyclictest1342499-21munin-run07:45:001
134070199541,8cyclictest1348484-21cron09:40:011
1340701995416,32cyclictest0-21swapper/110:00:011
134070199541,14cyclictest1353654-21sshd11:17:201
134070199541,13cyclictest1350995-21latency_hist10:25:021
134070199541,11cyclictest1355996-21sshd12:02:201
134070199541,11cyclictest1355996-21sshd12:02:191
134069699542,14cyclictest1346118-21sshd08:50:190
1340696995417,32cyclictest12-21ksoftirqd/010:08:200
134069699541,6cyclictest364-21snmpd08:26:370
134070799532,16cyclictest1344033-21munin-run08:14:593
134070799532,16cyclictest1341855-21wc07:30:033
1340707995319,9cyclictest1349267-21cron09:55:013
134070199532,17cyclictest1351631-21sendmail-msp10:40:001
134070199532,14cyclictest1355751-21cut12:00:001
134070199531,13cyclictest1349262-21sshd09:54:211
1340707995212,13cyclictest1-21systemd09:25:003
134070599527,26cyclictest1344284-21modprobe08:19:592
1340705995234,9cyclictest309-21in:imuxsock07:45:002
1340705995216,22cyclictest0-21swapper/210:00:012
1340701995236,12cyclictest1-21systemd11:55:011
134070199523,5cyclictest1354700-21cron11:40:001
134070199521,9cyclictest1349778-21modprobe10:01:041
134070199521,7cyclictest414-21sshd10:54:201
1340701995217,31cyclictest1347739-21latency_hist09:25:021
134070199521,17cyclictest1352878-21sshd11:00:211
134069699521,6cyclictest364-21snmpd07:50:180
1340707995120,5cyclictest1350222-21cat10:10:023
1340705995124,20cyclictest275-21dbus-daemon09:25:012
134070199512,8cyclictest1351353-21munin-run10:35:011
134070199512,13cyclictest1354257-21latency_hist11:30:021
134070199512,12cyclictest1346414-21munin-run09:00:001
1340701995113,34cyclictest1353254-21latency_hist11:10:021
1340701995113,34cyclictest1353254-21latency_hist11:10:011
134070199511,12cyclictest364-21snmpd07:48:161
134070199511,10cyclictest1352032-21date10:45:011
134069699512,6cyclictest364-21snmpd10:41:240
134070799503,15cyclictest1350448-21latency_hist10:15:033
1340707995016,5cyclictest1345204-21latency_hist08:35:023
134070199504,7cyclictest1345076-21cut08:35:001
134070199502,9cyclictest238-21systemd-journal12:10:001
134070199502,14cyclictest1350275-21sshd10:10:191
134070199502,13cyclictest1355239-21munin-run11:49:591
134070199501,10cyclictest1348759-21modprobe09:43:201
134069699501,5cyclictest1353943-21sendmail-mta11:24:260
1340707994919,5cyclictest1345965-21latency_hist08:50:013
134070599499,25cyclictest1341177-21modprobe07:20:002
134070599497,26cyclictest1350569-21modprobe10:20:002
1340705994922,20cyclictest275-21dbus-daemon10:25:002
134070199497,37cyclictest0-21swapper/112:30:001
134070199493,6cyclictest1353404-21cron11:15:001
134070199492,7cyclictest311-21rs:main1
134070199492,13cyclictest1340908-21modprobe07:14:211
134070199492,13cyclictest1340908-21modprobe07:14:211
134070199492,11cyclictest1342266-21latency_hist07:40:021
134069699491,2cyclictest0-21swapper/007:25:000
134070799482,19cyclictest1343277-21sendmail-msp08:00:003
134070799482,18cyclictest1344319-21sendmail-msp08:20:013
134070799482,13cyclictest1346871-21latency_hist09:05:023
134070799482,13cyclictest1346871-21latency_hist09:05:023
1340707994818,9cyclictest1-21systemd09:15:003
1340707994818,4cyclictest414-21sshd12:29:213
1340707994816,9cyclictest37-21ksoftirqd/309:45:003
1340707994816,5cyclictest1340715-21latency_hist07:10:023
1340705994825,15cyclictest238-21systemd-journal08:30:012
134070199485,4cyclictest0-21swapper/108:38:161
134070199482,18cyclictest1350559-21cron10:20:001
134069699482,4cyclictest0-21swapper/009:54:490
134070799473,12cyclictest1352642-21systemctl11:00:003
1340707994716,10cyclictest37-21ksoftirqd/307:25:003
134070599474,12cyclictest30-21ksoftirqd/212:09:592
134070199472,6cyclictest1343535-21true08:05:001
134070199472,10cyclictest1344034-21munin-plugin-st08:14:591
1340707994621,7cyclictest37-21ksoftirqd/312:21:363
1340707994615,9cyclictest37-21ksoftirqd/310:50:023
134070599463,33cyclictest1342750-21grep07:50:012
1340705994628,10cyclictest309-21in:imuxsock08:50:002
1340705994615,16cyclictest0-21swapper/211:40:002
134070199461,41cyclictest364-21snmpd10:26:561
134070199461,10cyclictest1350048-21modprobe10:10:001
134070599455,25cyclictest1341716-21munin-run07:30:002
1340705994529,11cyclictest309-21in:imuxsock08:05:012
1340705994526,14cyclictest30-21ksoftirqd/210:55:002
1340707994418,6cyclictest37-21ksoftirqd/308:10:023
1340707994418,6cyclictest37-21ksoftirqd/308:10:013
1340705994425,13cyclictest275-21dbus-daemon11:00:012
1340705994423,15cyclictest275-21dbus-daemon10:30:012
134070199441,8cyclictest1340738-21latency_hist07:10:011
1340707994331,8cyclictest275-21dbus-daemon11:45:013
1340707994330,9cyclictest238-21systemd-journal10:30:013
134070599434,29cyclictest1343781-21munin-plugin-st08:10:002
134070599434,29cyclictest1343781-21munin-plugin-st08:10:002
1340705994330,8cyclictest1353404-21cron11:15:002
1340705994330,7cyclictest309-21in:imuxsock07:40:002
1340705994324,13cyclictest238-21systemd-journal09:00:002
1340707994226,10cyclictest37-21ksoftirqd/307:45:023
1340707994224,14cyclictest275-21dbus-daemon08:05:003
134070599424,26cyclictest1356777-21modprobe12:20:012
134070599423,29cyclictest1351771-21grep10:40:012
134070599422,4cyclictest131rcu_preempt11:35:012
1340705994224,12cyclictest275-21dbus-daemon11:00:212
134070599417,19cyclictest1345367-21modprobe08:40:012
134070599415,25cyclictest238-21systemd-journal09:20:012
134070599415,25cyclictest238-21systemd-journal09:20:002
134070599414,26cyclictest1345074-21munin-run08:34:592
134070599413,28cyclictest1-21systemd12:40:012
134070599413,24cyclictest1353675-21modprobe11:19:592
1340705994119,16cyclictest1-21systemd08:00:002
1340707994029,8cyclictest1349014-21cron09:49:593
1340707994028,8cyclictest1352355-21sshd10:51:213
1340707994027,9cyclictest1-21systemd11:30:003
134070599405,19cyclictest1348490-21modprobe09:40:002
1340705994028,9cyclictest30-21ksoftirqd/211:45:012
1340705994023,13cyclictest238-21systemd-journal10:35:022
1340705994022,12cyclictest309-21in:imuxsock10:01:202
134070599394,26cyclictest309-21in:imuxsock09:15:012
1340705993930,5cyclictest1347991-21latency_hist09:29:592
1340705993921,12cyclictest275-21dbus-daemon10:50:022
1340705993920,15cyclictest1349053-21cat09:50:022
1340705993920,14cyclictest1-21systemd08:15:012
1340707993829,5cyclictest1352058-21latency_hist10:45:023
134070599389,19cyclictest1355730-21modprobe11:59:592
1340705993820,12cyclictest275-21dbus-daemon12:05:012
1340705993820,12cyclictest275-21dbus-daemon12:05:012
1340707993725,9cyclictest309-21in:imuxsock07:50:023
134070599379,4cyclictest131rcu_preempt07:33:012
134070599378,22cyclictest1346150-21cron08:54:592
1340705993725,8cyclictest30-21ksoftirqd/210:45:002
1340705993720,9cyclictest309-21in:imuxsock12:15:002
1340707993617,14cyclictest275-21dbus-daemon08:55:003
134070599366,18cyclictest1357056-21modprobe12:25:002
1340705993628,6cyclictest30-21ksoftirqd/207:13:212
1340705993628,6cyclictest30-21ksoftirqd/207:13:202
1340707993526,6cyclictest1353389-21sshd11:11:193
1340707993523,8cyclictest1351335-21sshd10:34:193
1340707993519,12cyclictest1-21systemd07:15:023
1340707993519,12cyclictest1-21systemd07:15:013
134070599353,3cyclictest131rcu_preempt08:45:012
134070599353,3cyclictest131rcu_preempt08:45:002
1340705993522,10cyclictest30-21ksoftirqd/211:51:202
1340705993522,10cyclictest30-21ksoftirqd/208:25:012
1340705993521,11cyclictest238-21systemd-journal09:55:002
1340705993520,11cyclictest1-21systemd12:30:012
134070599345,21cyclictest238-21systemd-journal09:45:002
134070599343,24cyclictest1341466-21munin-plugin-st07:25:012
1340705993423,8cyclictest30-21ksoftirqd/210:10:002
1340705993422,9cyclictest30-21ksoftirqd/211:30:022
1340705993418,10cyclictest1353156-21modprobe11:10:012
1340705993418,10cyclictest1353156-21modprobe11:10:002
1340707993324,5cyclictest1354637-21latency_hist11:35:023
134070599333,22cyclictest1355241-21cut11:50:002
134070599332,23cyclictest238-21systemd-journal11:25:012
1340707993216,12cyclictest275-21dbus-daemon12:35:013
134070599325,17cyclictest1346685-21munin-plugin-st09:05:012
134070599325,17cyclictest1346685-21munin-plugin-st09:05:002
1340705993220,8cyclictest30-21ksoftirqd/212:35:022
1340707993124,4cyclictest1353954-21latency_hist11:25:023
134070599316,15cyclictest1348241-21modprobe09:35:012
134070599303,20cyclictest1343016-21latency_hist07:55:002
1340705993024,4cyclictest1340644-21latency_hist07:10:022
1340707992922,4cyclictest1355236-21latency_hist11:50:013
1340707992817,7cyclictest238-21systemd-journal11:50:203
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional